Jul 27 09:25:56 user nova-compute[70374]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 27 09:25:59 user nova-compute[70374]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70374) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70374) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70374) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 09:25:59 user nova-compute[70374]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:25:59 user nova-compute[70374]: INFO nova.virt.driver [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 27 09:25:59 user nova-compute[70374]: INFO nova.compute.provider_config [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] Acquiring lock "singleton_lock" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] Acquired lock "singleton_lock" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] Releasing lock "singleton_lock" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] Full set of CONF: {{(pid=70374) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ******************************************************************************** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] Configuration options gathered from: {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ================================================================================ {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] allow_resize_to_same_host      = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] arq_binding_timeout            = 300 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] backdoor_port                  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] backdoor_socket                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] block_device_allocate_retries  = 300 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] block_device_allocate_retries_interval = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cert                           = self.pem {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute_monitors               = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] config_dir                     = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] config_drive_format            = iso9660 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] config_source                  = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] console_host                   = user {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] control_exchange               = nova {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cpu_allocation_ratio           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] daemon                         = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] debug                          = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] default_access_ip_network_name = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] default_availability_zone      = nova {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] default_ephemeral_format       = ext4 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] default_schedule_zone          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] disk_allocation_ratio          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] enable_new_services            = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] enabled_apis                   = ['osapi_compute'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] enabled_ssl_apis               = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] flat_injected                  = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] force_config_drive             = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] force_raw_images               = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] graceful_shutdown_timeout      = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] heal_instance_info_cache_interval = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] host                           = user {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] instance_build_timeout         = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] instance_delete_interval       = 300 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] instance_format                = [instance: %(uuid)s]  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] instance_name_template         = instance-%08x {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] instance_usage_audit           = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] instance_usage_audit_period    = month {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] internal_service_availability_zone = internal {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] key                            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] live_migration_retry_count     = 30 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] log_config_append              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] log_dir                        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] log_file                       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] log_options                    = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] log_rotate_interval            = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] log_rotate_interval_type       = days {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] log_rotation_type              = none {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] long_rpc_timeout               = 1800 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] max_concurrent_builds          = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] max_concurrent_live_migrations = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] max_concurrent_snapshots       = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] max_local_block_devices        = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] max_logfile_count              = 30 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] max_logfile_size_mb            = 200 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] maximum_instance_delete_attempts = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] metadata_listen                = 0.0.0.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] metadata_listen_port           = 8775 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] metadata_workers               = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] migrate_max_retries            = -1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] mkisofs_cmd                    = genisoimage {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] my_ip                          = 10.0.0.210 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] network_allocate_retries       = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] osapi_compute_listen_port      = 8774 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] osapi_compute_unique_server_name_scope =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] osapi_compute_workers          = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] password_length                = 12 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] periodic_enable                = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] periodic_fuzzy_delay           = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] pointer_model                  = ps2mouse {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] preallocate_images             = none {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] publish_errors                 = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] pybasedir                      = /opt/stack/nova {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ram_allocation_ratio           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] rate_limit_burst               = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] rate_limit_except_level        = CRITICAL {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] rate_limit_interval            = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] reboot_timeout                 = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] reclaim_instance_interval      = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] record                         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] reimage_timeout_per_gb         = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] report_interval                = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] rescue_timeout                 = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] reserved_host_cpus             = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] reserved_host_disk_mb          = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] reserved_host_memory_mb        = 512 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] reserved_huge_pages            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] resize_confirm_window          = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] resize_fs_using_block_device   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] resume_guests_state_on_host_boot = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] rpc_response_timeout           = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] run_external_periodic_tasks    = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] running_deleted_instance_action = reap {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] running_deleted_instance_poll_interval = 1800 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] running_deleted_instance_timeout = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler_instance_sync_interval = 120 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_down_time              = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] servicegroup_driver            = db {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] shelved_offload_time           = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] shelved_poll_interval          = 3600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] shutdown_timeout               = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] source_is_ipv6                 = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ssl_only                       = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] state_path                     = /opt/stack/data/nova {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] sync_power_state_interval      = 600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] sync_power_state_pool_size     = 1000 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] syslog_log_facility            = LOG_USER {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] tempdir                        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] timeout_nbd                    = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] transport_url                  = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] update_resources_interval      = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] use_cow_images                 = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] use_eventlog                   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] use_journal                    = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] use_json                       = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] use_rootwrap_daemon            = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] use_stderr                     = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] use_syslog                     = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vcpu_pin_set                   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plugging_is_fatal          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plugging_timeout           = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] virt_mkfs                      = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] volume_usage_poll_interval     = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] watch_log_file                 = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] web                            = /usr/share/spice-html5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_concurrency.disable_process_locking = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.auth_strategy              = keystone {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.compute_link_prefix        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.dhcp_domain                = novalocal {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.enable_instance_password   = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.glance_link_prefix         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.instance_list_per_project_cells = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.list_records_by_skipping_down_cells = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.local_metadata_per_cell    = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.max_limit                  = 1000 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.metadata_cache_expiration  = 15 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.neutron_default_tenant_id  = default {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.use_forwarded_for          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.use_neutron_default_nets   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.vendordata_dynamic_targets = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.vendordata_jsonfile_path   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.backend                  = dogpile.cache.memcached {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.backend_argument         = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.config_prefix            = cache.oslo {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.dead_timeout             = 60.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.debug_cache_backend      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.enable_retry_client      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.enable_socket_keepalive  = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.enabled                  = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.expiration_time          = 600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.hashclient_retry_attempts = 2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_dead_retry      = 300 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_password        =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_pool_maxsize    = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_sasl_enabled    = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.memcache_username        =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.proxies                  = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.retry_attempts           = 2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.retry_delay              = 0.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.socket_keepalive_count   = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.socket_keepalive_idle    = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.socket_keepalive_interval = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.tls_allowed_ciphers      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.tls_cafile               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.tls_certfile             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.tls_enabled              = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cache.tls_keyfile              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.auth_section            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.auth_type               = password {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.cafile                  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.certfile                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.collect_timing          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.cross_az_attach         = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.debug                   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.endpoint_template       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.http_retries            = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.insecure                = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.keyfile                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.os_region_name          = RegionOne {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.split_loggers           = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cinder.timeout                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.cpu_dedicated_set      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.cpu_shared_set         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.image_type_exclude_list = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.max_concurrent_disk_ops = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.max_disk_devices_to_attach = -1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.resource_provider_association_refresh = 300 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.shutdown_retry_interval = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] conductor.workers              = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] console.allowed_origins        = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] console.ssl_ciphers            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] console.ssl_minimum_version    = default {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] consoleauth.token_ttl          = 600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.cafile                  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.certfile                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.collect_timing          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.connect_retries         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.connect_retry_delay     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.endpoint_override       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.insecure                = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.keyfile                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.max_version             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.min_version             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.region_name             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.service_name            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.service_type            = accelerator {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.split_loggers           = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.status_code_retries     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.status_code_retry_delay = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.timeout                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] cyborg.version                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.backend               = sqlalchemy {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.connection            = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.connection_debug      = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.connection_parameters =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.connection_recycle_time = 3600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.connection_trace      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.db_inc_retry_interval = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.db_max_retries        = 20 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.db_max_retry_interval = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.db_retry_interval     = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.max_overflow          = 50 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.max_pool_size         = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.max_retries           = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.mysql_enable_ndb      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.mysql_wsrep_sync_wait = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.pool_timeout          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.retry_interval        = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.slave_connection      = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] database.sqlite_synchronous    = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.backend           = sqlalchemy {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.connection        = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.connection_debug  = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.connection_parameters =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.connection_recycle_time = 3600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.connection_trace  = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.db_inc_retry_interval = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.db_max_retries    = 20 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.db_max_retry_interval = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.db_retry_interval = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.max_overflow      = 50 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.max_pool_size     = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.max_retries       = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.mysql_enable_ndb  = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.pool_timeout      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.retry_interval    = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.slave_connection  = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] api_database.sqlite_synchronous = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] devices.enabled_mdev_types     = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ephemeral_storage_encryption.enabled = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.api_servers             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.cafile                  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.certfile                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.collect_timing          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.connect_retries         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.connect_retry_delay     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.debug                   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.default_trusted_certificate_ids = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.enable_certificate_validation = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.enable_rbd_download     = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.endpoint_override       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.insecure                = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.keyfile                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.max_version             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.min_version             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.num_retries             = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.rbd_ceph_conf           =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.rbd_connect_timeout     = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.rbd_pool                =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.rbd_user                =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.region_name             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.service_name            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.service_type            = image {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.split_loggers           = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.status_code_retries     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.status_code_retry_delay = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.timeout                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.verify_glance_signatures = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] glance.version                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] guestfs.debug                  = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.config_drive_cdrom      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.config_drive_inject_password = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.enable_instance_metrics_collection = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.enable_remotefx         = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.instances_path_share    =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.iscsi_initiator_list    = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.limit_cpu_features      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.power_state_check_timeframe = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.use_multipath_io        = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.volume_attach_retry_count = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.vswitch_name            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] mks.enabled                    = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] image_cache.manager_interval   = 2400 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] image_cache.precache_concurrency = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] image_cache.remove_unused_base_images = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] image_cache.subdirectory_name  = _base {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.api_max_retries         = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.api_retry_interval      = 2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.auth_section            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.auth_type               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.cafile                  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.certfile                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.collect_timing          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.connect_retries         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.connect_retry_delay     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.endpoint_override       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.insecure                = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.keyfile                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.max_version             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.min_version             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.partition_key           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.peer_list               = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.region_name             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.serial_console_state_timeout = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.service_name            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.service_type            = baremetal {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.split_loggers           = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.status_code_retries     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.status_code_retry_delay = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.timeout                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ironic.version                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] key_manager.fixed_key          = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.barbican_api_version  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.barbican_endpoint     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.barbican_endpoint_type = public {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.barbican_region_name  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.cafile                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.certfile              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.collect_timing        = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.insecure              = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.keyfile               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.number_of_retries     = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.retry_delay           = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.send_service_user_token = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.split_loggers         = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.timeout               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.verify_ssl            = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican.verify_ssl_path       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.auth_section = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.auth_type = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.cafile   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.certfile = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.collect_timing = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.insecure = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.keyfile  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.split_loggers = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] barbican_service_user.timeout  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.approle_role_id          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.approle_secret_id        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.cafile                   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.certfile                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.collect_timing           = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.insecure                 = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.keyfile                  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.kv_mountpoint            = secret {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.kv_version               = 2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.namespace                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.root_token_id            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.split_loggers            = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.ssl_ca_crt_file          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.timeout                  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.use_ssl                  = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.cafile                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.certfile              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.collect_timing        = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.connect_retries       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.connect_retry_delay   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.endpoint_override     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.insecure              = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.keyfile               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.max_version           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.min_version           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.region_name           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.service_name          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.service_type          = identity {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.split_loggers         = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.status_code_retries   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.status_code_retry_delay = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.timeout               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] keystone.version               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.connection_uri         =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.cpu_mode               = custom {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: WARNING oslo_config.cfg [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.cpu_power_governor_high = performance {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.cpu_power_governor_low = powersave {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.cpu_power_management   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.device_detach_attempts = 8 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.device_detach_timeout  = 20 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.disk_cachemodes        = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.disk_prefix            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.enabled_perf_events    = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.file_backed_memory     = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.gid_maps               = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.hw_disk_discard        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.hw_machine_type        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.images_rbd_glance_store_name =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.images_rbd_pool        = rbd {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.images_type            = default {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.images_volume_group    = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.inject_key             = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.inject_partition       = -2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.inject_password        = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.iscsi_iface            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.iser_use_multipath     = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_bandwidth = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_downtime = 500 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_inbound_addr = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_permit_post_copy = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_scheme  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_timeout_action = abort {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_tunnelled = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: WARNING oslo_config.cfg [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 27 09:25:59 user nova-compute[70374]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 27 09:25:59 user nova-compute[70374]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 27 09:25:59 user nova-compute[70374]: and ``live_migration_inbound_addr`` respectively.
Jul 27 09:25:59 user nova-compute[70374]: ).  Its value may be silently ignored in the future.
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.live_migration_with_native_tls = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.max_queues             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.nfs_mount_options      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.num_memory_encrypted_guests = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.num_pcie_ports         = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.pmem_namespaces        = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.quobyte_client_cfg     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rbd_secret_uuid        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rbd_user               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.remote_filesystem_transport = ssh {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rescue_image_id        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rescue_kernel_id       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rescue_ramdisk_id      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.rx_queue_size          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.smbfs_mount_options    =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.snapshot_compression   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.snapshot_image_format  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.sparse_logical_volumes = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.swtpm_enabled          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.swtpm_group            = tss {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.swtpm_user             = tss {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.sysinfo_serial         = unique {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.tb_cache_size          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.tx_queue_size          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.uid_maps               = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.use_virtio_for_bridges = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.virt_type              = kvm {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.volume_clear           = zero {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.volume_clear_size      = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.volume_use_multipath   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.vzstorage_cache_path   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.vzstorage_mount_user   = stack {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.auth_section           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.auth_type              = password {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.cafile                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.certfile               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.collect_timing         = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.connect_retries        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.connect_retry_delay    = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.default_floating_pool  = public {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.endpoint_override      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.extension_sync_interval = 600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.http_retries           = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.insecure               = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.keyfile                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.max_version            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.min_version            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.ovs_bridge             = br-int {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.physnets               = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.region_name            = RegionOne {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.service_metadata_proxy = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.service_name           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.service_type           = network {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.split_loggers          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.status_code_retries    = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.status_code_retry_delay = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.timeout                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] neutron.version                = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] notifications.bdms_in_notifications = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] notifications.default_level    = INFO {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] notifications.notification_format = unversioned {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] notifications.notify_on_state_change = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] pci.alias                      = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] pci.device_spec                = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] pci.report_in_placement        = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.auth_section         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.auth_type            = password {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.cafile               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.certfile             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.collect_timing       = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.connect_retries      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.connect_retry_delay  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.default_domain_id    = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.default_domain_name  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.domain_id            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.domain_name          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.endpoint_override    = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.insecure             = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.keyfile              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.max_version          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.min_version          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.password             = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.project_domain_id    = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.project_domain_name  = Default {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.project_id           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.project_name         = service {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.region_name          = RegionOne {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.service_name         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.service_type         = placement {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.split_loggers        = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.status_code_retries  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.status_code_retry_delay = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.system_scope         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.timeout              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.trust_id             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.user_domain_id       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.user_domain_name     = Default {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.user_id              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.username             = placement {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] placement.version              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.cores                    = 20 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.count_usage_from_placement = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.injected_file_content_bytes = 10240 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.injected_file_path_length = 255 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.injected_files           = 5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.instances                = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.key_pairs                = 100 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.metadata_items           = 128 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.ram                      = 51200 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.recheck_quota            = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.server_group_members     = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] quota.server_groups            = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] rdp.enabled                    = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.image_metadata_prefilter = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.max_attempts         = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.max_placement_results = 1000 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.query_placement_for_availability_zone = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.query_placement_for_image_type_support = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] scheduler.workers              = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.host_subset_size = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.isolated_hosts = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.isolated_images = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.pci_in_placement = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.track_instance_changes = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] metrics.required               = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] metrics.weight_multiplier      = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] metrics.weight_setting         = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] serial_console.enabled         = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] serial_console.port_range      = 10000:20000 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] serial_console.serialproxy_port = 6083 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.auth_section      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.auth_type         = password {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.cafile            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.certfile          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.collect_timing    = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.insecure          = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.keyfile           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.send_service_user_token = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.split_loggers     = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] service_user.timeout           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.agent_enabled            = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.enabled                  = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.html5proxy_port          = 6082 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.image_compression        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.jpeg_compression         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.playback_compression     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.server_listen            = 127.0.0.1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.streaming_mode           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] spice.zlib_compression         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] upgrade_levels.baseapi         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] upgrade_levels.cert            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] upgrade_levels.compute         = auto {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] upgrade_levels.conductor       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] upgrade_levels.scheduler       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.auth_section = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.auth_type = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.cafile = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.certfile = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.insecure = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.keyfile = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vendordata_dynamic_auth.timeout = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.api_retry_count         = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.ca_file                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.cache_prefix            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.cluster_name            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.connection_pool_size    = 10 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.console_delay_seconds   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.datastore_regex         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.host_ip                 = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.host_password           = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.host_port               = 443 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.host_username           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.insecure                = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.integration_bridge      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.maximum_objects         = 100 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.pbm_default_policy      = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.pbm_enabled             = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.pbm_wsdl_location       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.serial_port_proxy_uri   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.serial_port_service_uri = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.task_poll_interval      = 0.5 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.use_linked_clone        = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.vnc_keymap              = en-us {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.vnc_port                = 5900 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vmware.vnc_port_total          = 10000 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.auth_schemes               = ['none'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.enabled                    = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.novncproxy_port            = 6080 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.server_listen              = 0.0.0.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.vencrypt_ca_certs          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.vencrypt_client_cert       = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vnc.vencrypt_client_key        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.disable_rootwrap   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.enable_numa_live_migration = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.libvirt_disable_apic = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.client_socket_timeout     = 900 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.default_pool_size         = 1000 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.keep_alive                = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.max_header_line           = 16384 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.ssl_ca_file               = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.ssl_cert_file             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.ssl_key_file              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.tcp_keepidle              = 600 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] zvm.ca_file                    = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] zvm.cloud_connector_url        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] zvm.reachable_timeout          = 300 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.enforce_new_defaults = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.enforce_scope      = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.policy_default_rule = default {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.policy_file        = policy.yaml {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.connection_string     = messaging:// {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.enabled               = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.es_doc_type           = notification {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.es_scroll_size        = 10000 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.es_scroll_time        = 2m {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.filter_error_trace    = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.hmac_keys             = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.sentinel_service_name = mymaster {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.socket_timeout        = 0.1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.trace_requests        = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler.trace_sqlalchemy      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler_jaeger.process_tags   = {} {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler_jaeger.service_name_prefix = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] profiler_otlp.service_name_prefix = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] remote_debug.host              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] remote_debug.port              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.ssl      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_notifications.retry = -1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.auth_section        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.auth_type           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.cafile              = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.certfile            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.collect_timing      = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.connect_retries     = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.connect_retry_delay = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.endpoint_id         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.endpoint_override   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.insecure            = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.keyfile             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.max_version         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.min_version         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.region_name         = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.service_name        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.service_type        = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.split_loggers       = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.status_code_retries = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.status_code_retry_delay = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.timeout             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.valid_interfaces    = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_limit.version             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_reports.file_event_handler = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] oslo_reports.log_dir           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_ovs_privileged.group  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] vif_plug_ovs_privileged.user   = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_linux_bridge.flat_interface = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_ovs.isolate_vif         = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_vif_ovs.per_port_bridge     = False {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] os_brick.lock_path             = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] privsep_osbrick.capabilities   = [21] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] privsep_osbrick.group          = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] privsep_osbrick.helper_command = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] privsep_osbrick.user           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] nova_sys_admin.group           = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] nova_sys_admin.helper_command  = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] nova_sys_admin.user            = None {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG oslo_service.service [None req-ac66df63-fac3-4a0b-9c91-837479754330 None None] ******************************************************************************** {{(pid=70374) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 27 09:25:59 user nova-compute[70374]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 27 09:25:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Starting native event thread {{(pid=70374) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Starting green dispatch thread {{(pid=70374) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Starting connection event dispatch thread {{(pid=70374) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Connecting to libvirt: qemu:///system {{(pid=70374) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f28037cb820> {{(pid=70374) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 27 09:25:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f28037cb820> {{(pid=70374) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 27 09:25:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Connection event '1' reason 'None'
Jul 27 09:25:59 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 09:25:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.mount [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Initialising _HostMountState generation 0 {{(pid=70374) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 27 09:26:07 user nova-compute[70374]: INFO nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host capabilities <capabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <host>
Jul 27 09:26:07 user nova-compute[70374]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 27 09:26:07 user nova-compute[70374]:     <cpu>
Jul 27 09:26:07 user nova-compute[70374]:       <arch>x86_64</arch>
Jul 27 09:26:07 user nova-compute[70374]:       <model>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <microcode version='1070'/>
Jul 27 09:26:07 user nova-compute[70374]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 27 09:26:07 user nova-compute[70374]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='osxsave'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='invtsc'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='rsba'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature name='skip-l1dfl-vmentry'/>
Jul 27 09:26:07 user nova-compute[70374]:       <pages unit='KiB' size='4'/>
Jul 27 09:26:07 user nova-compute[70374]:       <pages unit='KiB' size='2048'/>
Jul 27 09:26:07 user nova-compute[70374]:     </cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <power_management>
Jul 27 09:26:07 user nova-compute[70374]:       <suspend_mem/>
Jul 27 09:26:07 user nova-compute[70374]:       <suspend_disk/>
Jul 27 09:26:07 user nova-compute[70374]:       <suspend_hybrid/>
Jul 27 09:26:07 user nova-compute[70374]:     </power_management>
Jul 27 09:26:07 user nova-compute[70374]:     <iommu support='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <migration_features>
Jul 27 09:26:07 user nova-compute[70374]:       <live/>
Jul 27 09:26:07 user nova-compute[70374]:       <uri_transports>
Jul 27 09:26:07 user nova-compute[70374]:         <uri_transport>tcp</uri_transport>
Jul 27 09:26:07 user nova-compute[70374]:         <uri_transport>rdma</uri_transport>
Jul 27 09:26:07 user nova-compute[70374]:       </uri_transports>
Jul 27 09:26:07 user nova-compute[70374]:     </migration_features>
Jul 27 09:26:07 user nova-compute[70374]:     <topology>
Jul 27 09:26:07 user nova-compute[70374]:       <cells num='2'>
Jul 27 09:26:07 user nova-compute[70374]:         <cell id='0'>
Jul 27 09:26:07 user nova-compute[70374]:           <memory unit='KiB'>8140616</memory>
Jul 27 09:26:07 user nova-compute[70374]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 27 09:26:07 user nova-compute[70374]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 09:26:07 user nova-compute[70374]:           <distances>
Jul 27 09:26:07 user nova-compute[70374]:             <sibling id='0' value='10'/>
Jul 27 09:26:07 user nova-compute[70374]:             <sibling id='1' value='20'/>
Jul 27 09:26:07 user nova-compute[70374]:           </distances>
Jul 27 09:26:07 user nova-compute[70374]:           <cpus num='6'>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 27 09:26:07 user nova-compute[70374]:           </cpus>
Jul 27 09:26:07 user nova-compute[70374]:         </cell>
Jul 27 09:26:07 user nova-compute[70374]:         <cell id='1'>
Jul 27 09:26:07 user nova-compute[70374]:           <memory unit='KiB'>8255100</memory>
Jul 27 09:26:07 user nova-compute[70374]:           <pages unit='KiB' size='4'>2063775</pages>
Jul 27 09:26:07 user nova-compute[70374]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 09:26:07 user nova-compute[70374]:           <distances>
Jul 27 09:26:07 user nova-compute[70374]:             <sibling id='0' value='20'/>
Jul 27 09:26:07 user nova-compute[70374]:             <sibling id='1' value='10'/>
Jul 27 09:26:07 user nova-compute[70374]:           </distances>
Jul 27 09:26:07 user nova-compute[70374]:           <cpus num='6'>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 27 09:26:07 user nova-compute[70374]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 27 09:26:07 user nova-compute[70374]:           </cpus>
Jul 27 09:26:07 user nova-compute[70374]:         </cell>
Jul 27 09:26:07 user nova-compute[70374]:       </cells>
Jul 27 09:26:07 user nova-compute[70374]:     </topology>
Jul 27 09:26:07 user nova-compute[70374]:     <cache>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 27 09:26:07 user nova-compute[70374]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 27 09:26:07 user nova-compute[70374]:     </cache>
Jul 27 09:26:07 user nova-compute[70374]:     <secmodel>
Jul 27 09:26:07 user nova-compute[70374]:       <model>apparmor</model>
Jul 27 09:26:07 user nova-compute[70374]:       <doi>0</doi>
Jul 27 09:26:07 user nova-compute[70374]:     </secmodel>
Jul 27 09:26:07 user nova-compute[70374]:     <secmodel>
Jul 27 09:26:07 user nova-compute[70374]:       <model>dac</model>
Jul 27 09:26:07 user nova-compute[70374]:       <doi>0</doi>
Jul 27 09:26:07 user nova-compute[70374]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 27 09:26:07 user nova-compute[70374]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 27 09:26:07 user nova-compute[70374]:     </secmodel>
Jul 27 09:26:07 user nova-compute[70374]:   </host>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='alpha'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>clipper</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='armv6l'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>spitz</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>nuri</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>kzm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sx1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>z2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>tosa</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>n810</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>n800</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>terrier</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>midway</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>microbit</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>verdex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>highbank</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>akita</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>connex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>collie</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='armv7l'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>spitz</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>nuri</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>kzm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sx1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>z2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>tosa</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>n810</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>n800</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>terrier</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>midway</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>microbit</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>verdex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>highbank</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>akita</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>connex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>collie</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='aarch64'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>spitz</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>nuri</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>kzm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sx1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>z2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>tosa</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>n810</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>n800</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>terrier</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>midway</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>microbit</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>verdex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>raspi3b</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>highbank</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>akita</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>connex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>collie</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <acpi default='on' toggle='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='cris'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='i686'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>isapc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>microvm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='kvm'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <pae/>
Jul 27 09:26:07 user nova-compute[70374]:       <nonpae/>
Jul 27 09:26:07 user nova-compute[70374]:       <acpi default='on' toggle='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:       <apic default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='m68k'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>an5206</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>q800</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>next-cube</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='microblaze'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='microblazeel'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='mips'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='16'>malta</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='mipsel'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='16'>malta</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='mips64'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='16'>malta</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>pica61</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>magnum</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='mips64el'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='16'>malta</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>pica61</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>magnum</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='16'>boston</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='ppc'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mac99</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>40p</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>taihu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='ppc64'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>taihu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>40p</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mac99</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='ppc64le'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>taihu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>40p</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>mac99</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='riscv32'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='8'>spike</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>opentitan</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='8'>virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='riscv64'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='8'>spike</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>shakti_c</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='8'>virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='s390x'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='sh4'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>shix</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>r2d</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='sh4eb'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>shix</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>r2d</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='sparc'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>SS-5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>SS-20</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>LX</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>SS-4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>SS-10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>Voyager</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='sparc64'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sun4u</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>niagara</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>sun4v</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='x86_64'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>64</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='1'>isapc</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>microvm</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='kvm'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <acpi default='on' toggle='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:       <apic default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='xtensa'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>sim</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>kc705</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>ml605</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>lx200</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>lx60</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]:   <guest>
Jul 27 09:26:07 user nova-compute[70374]:     <os_type>hvm</os_type>
Jul 27 09:26:07 user nova-compute[70374]:     <arch name='xtensaeb'>
Jul 27 09:26:07 user nova-compute[70374]:       <wordsize>32</wordsize>
Jul 27 09:26:07 user nova-compute[70374]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='4'>sim</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>kc705</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>ml605</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>virt</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>lx200</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>lx60</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 09:26:07 user nova-compute[70374]:       <domain type='qemu'/>
Jul 27 09:26:07 user nova-compute[70374]:     </arch>
Jul 27 09:26:07 user nova-compute[70374]:     <features>
Jul 27 09:26:07 user nova-compute[70374]:       <cpuselection/>
Jul 27 09:26:07 user nova-compute[70374]:       <deviceboot/>
Jul 27 09:26:07 user nova-compute[70374]:       <disksnapshot default='on' toggle='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     </features>
Jul 27 09:26:07 user nova-compute[70374]:   </guest>
Jul 27 09:26:07 user nova-compute[70374]: </capabilities>
Jul 27 09:26:07 user nova-compute[70374]: 
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 27 09:26:07 user nova-compute[70374]: <domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 09:26:07 user nova-compute[70374]:   <domain>kvm</domain>
Jul 27 09:26:07 user nova-compute[70374]:   <machine>pc-q35-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:   <arch>i686</arch>
Jul 27 09:26:07 user nova-compute[70374]:   <vcpu max='288'/>
Jul 27 09:26:07 user nova-compute[70374]:   <iothreads supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:   <os supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='firmware'/>
Jul 27 09:26:07 user nova-compute[70374]:     <loader supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>rom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pflash</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='readonly'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='secure'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </loader>
Jul 27 09:26:07 user nova-compute[70374]:   </os>
Jul 27 09:26:07 user nova-compute[70374]:   <cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-passthrough' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='hostPassthroughMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='maximum' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='maximumMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-model' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='umip'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibpb'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibrs'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='erms'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='lm'/>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='custom' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>qemu64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>qemu32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>phenom</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>n270</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>kvm64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>coreduo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>core2duo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>athlon</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Westmere</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Snowridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Penryn</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G5</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G4</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G1</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Rome</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Milan</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Dhyana</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cooperlake</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Conroe</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>486</model>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:   </cpu>
Jul 27 09:26:07 user nova-compute[70374]:   <memoryBacking supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='sourceType'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>file</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>anonymous</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>memfd</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:   </memoryBacking>
Jul 27 09:26:07 user nova-compute[70374]:   <devices>
Jul 27 09:26:07 user nova-compute[70374]:     <disk supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='diskDevice'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>disk</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cdrom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>floppy</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>lun</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='bus'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>fdc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sata</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </disk>
Jul 27 09:26:07 user nova-compute[70374]:     <graphics supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sdl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vnc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>spice</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egl-headless</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </graphics>
Jul 27 09:26:07 user nova-compute[70374]:     <video supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='modelType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cirrus</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vmvga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>qxl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>none</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>bochs</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ramfb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </video>
Jul 27 09:26:07 user nova-compute[70374]:     <hostdev supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='mode'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>subsystem</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='startupPolicy'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>default</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>mandatory</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>requisite</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>optional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='subsysType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pci</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='capsType'/>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='pciBackend'/>
Jul 27 09:26:07 user nova-compute[70374]:     </hostdev>
Jul 27 09:26:07 user nova-compute[70374]:     <rng supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>random</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egd</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>builtin</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </rng>
Jul 27 09:26:07 user nova-compute[70374]:     <filesystem supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='driverType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>path</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>handle</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtiofs</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </filesystem>
Jul 27 09:26:07 user nova-compute[70374]:     <tpm supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-tis</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-crb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>passthrough</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>emulator</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </tpm>
Jul 27 09:26:07 user nova-compute[70374]:   </devices>
Jul 27 09:26:07 user nova-compute[70374]:   <features>
Jul 27 09:26:07 user nova-compute[70374]:     <gic supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <vmcoreinfo supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <genid supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backingStoreInput supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backup supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <sev supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:   </features>
Jul 27 09:26:07 user nova-compute[70374]: </domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 27 09:26:07 user nova-compute[70374]: <domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 09:26:07 user nova-compute[70374]:   <domain>kvm</domain>
Jul 27 09:26:07 user nova-compute[70374]:   <machine>pc-i440fx-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:   <arch>i686</arch>
Jul 27 09:26:07 user nova-compute[70374]:   <vcpu max='255'/>
Jul 27 09:26:07 user nova-compute[70374]:   <iothreads supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:   <os supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='firmware'/>
Jul 27 09:26:07 user nova-compute[70374]:     <loader supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>rom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pflash</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='readonly'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='secure'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </loader>
Jul 27 09:26:07 user nova-compute[70374]:   </os>
Jul 27 09:26:07 user nova-compute[70374]:   <cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-passthrough' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='hostPassthroughMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='maximum' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='maximumMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-model' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='umip'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibpb'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibrs'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='erms'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='lm'/>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='custom' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>qemu64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>qemu32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>phenom</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>n270</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>kvm64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>coreduo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>core2duo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>athlon</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Westmere</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Snowridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Penryn</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G5</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G4</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G1</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Rome</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Milan</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Dhyana</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cooperlake</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Conroe</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>486</model>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:   </cpu>
Jul 27 09:26:07 user nova-compute[70374]:   <memoryBacking supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='sourceType'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>file</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>anonymous</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>memfd</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:   </memoryBacking>
Jul 27 09:26:07 user nova-compute[70374]:   <devices>
Jul 27 09:26:07 user nova-compute[70374]:     <disk supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='diskDevice'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>disk</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cdrom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>floppy</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>lun</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='bus'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ide</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>fdc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sata</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </disk>
Jul 27 09:26:07 user nova-compute[70374]:     <graphics supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sdl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vnc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>spice</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egl-headless</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </graphics>
Jul 27 09:26:07 user nova-compute[70374]:     <video supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='modelType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cirrus</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vmvga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>qxl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>none</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>bochs</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ramfb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </video>
Jul 27 09:26:07 user nova-compute[70374]:     <hostdev supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='mode'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>subsystem</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='startupPolicy'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>default</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>mandatory</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>requisite</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>optional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='subsysType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pci</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='capsType'/>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='pciBackend'/>
Jul 27 09:26:07 user nova-compute[70374]:     </hostdev>
Jul 27 09:26:07 user nova-compute[70374]:     <rng supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>random</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egd</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>builtin</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </rng>
Jul 27 09:26:07 user nova-compute[70374]:     <filesystem supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='driverType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>path</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>handle</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtiofs</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </filesystem>
Jul 27 09:26:07 user nova-compute[70374]:     <tpm supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-tis</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-crb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>passthrough</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>emulator</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </tpm>
Jul 27 09:26:07 user nova-compute[70374]:   </devices>
Jul 27 09:26:07 user nova-compute[70374]:   <features>
Jul 27 09:26:07 user nova-compute[70374]:     <gic supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <vmcoreinfo supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <genid supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backingStoreInput supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backup supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <sev supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:   </features>
Jul 27 09:26:07 user nova-compute[70374]: </domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 27 09:26:07 user nova-compute[70374]: <domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 09:26:07 user nova-compute[70374]:   <domain>kvm</domain>
Jul 27 09:26:07 user nova-compute[70374]:   <machine>pc-q35-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:   <arch>i686</arch>
Jul 27 09:26:07 user nova-compute[70374]:   <vcpu max='288'/>
Jul 27 09:26:07 user nova-compute[70374]:   <iothreads supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:   <os supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='firmware'/>
Jul 27 09:26:07 user nova-compute[70374]:     <loader supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>rom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pflash</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='readonly'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='secure'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </loader>
Jul 27 09:26:07 user nova-compute[70374]:   </os>
Jul 27 09:26:07 user nova-compute[70374]:   <cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-passthrough' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='hostPassthroughMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='maximum' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='maximumMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-model' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='umip'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibpb'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibrs'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='erms'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='lm'/>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='custom' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>qemu64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>qemu32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>phenom</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>n270</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>kvm64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>coreduo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>core2duo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>athlon</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Westmere</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Snowridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Penryn</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G5</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G4</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G1</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Rome</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Milan</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Dhyana</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cooperlake</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Conroe</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>486</model>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:   </cpu>
Jul 27 09:26:07 user nova-compute[70374]:   <memoryBacking supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='sourceType'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>file</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>anonymous</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>memfd</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:   </memoryBacking>
Jul 27 09:26:07 user nova-compute[70374]:   <devices>
Jul 27 09:26:07 user nova-compute[70374]:     <disk supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='diskDevice'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>disk</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cdrom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>floppy</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>lun</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='bus'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>fdc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sata</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </disk>
Jul 27 09:26:07 user nova-compute[70374]:     <graphics supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sdl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vnc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>spice</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egl-headless</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </graphics>
Jul 27 09:26:07 user nova-compute[70374]:     <video supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='modelType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cirrus</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vmvga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>qxl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>none</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>bochs</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ramfb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </video>
Jul 27 09:26:07 user nova-compute[70374]:     <hostdev supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='mode'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>subsystem</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='startupPolicy'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>default</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>mandatory</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>requisite</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>optional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='subsysType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pci</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='capsType'/>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='pciBackend'/>
Jul 27 09:26:07 user nova-compute[70374]:     </hostdev>
Jul 27 09:26:07 user nova-compute[70374]:     <rng supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>random</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egd</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>builtin</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </rng>
Jul 27 09:26:07 user nova-compute[70374]:     <filesystem supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='driverType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>path</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>handle</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtiofs</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </filesystem>
Jul 27 09:26:07 user nova-compute[70374]:     <tpm supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-tis</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-crb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>passthrough</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>emulator</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </tpm>
Jul 27 09:26:07 user nova-compute[70374]:   </devices>
Jul 27 09:26:07 user nova-compute[70374]:   <features>
Jul 27 09:26:07 user nova-compute[70374]:     <gic supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <vmcoreinfo supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <genid supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backingStoreInput supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backup supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <sev supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:   </features>
Jul 27 09:26:07 user nova-compute[70374]: </domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 27 09:26:07 user nova-compute[70374]: <domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 09:26:07 user nova-compute[70374]:   <domain>kvm</domain>
Jul 27 09:26:07 user nova-compute[70374]:   <machine>pc-i440fx-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:   <arch>i686</arch>
Jul 27 09:26:07 user nova-compute[70374]:   <vcpu max='255'/>
Jul 27 09:26:07 user nova-compute[70374]:   <iothreads supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:   <os supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='firmware'/>
Jul 27 09:26:07 user nova-compute[70374]:     <loader supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>rom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pflash</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='readonly'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='secure'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </loader>
Jul 27 09:26:07 user nova-compute[70374]:   </os>
Jul 27 09:26:07 user nova-compute[70374]:   <cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-passthrough' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='hostPassthroughMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='maximum' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='maximumMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-model' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='umip'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibpb'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibrs'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='erms'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='lm'/>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='custom' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>qemu64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>qemu32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>phenom</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>n270</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>kvm64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>coreduo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>core2duo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>athlon</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Westmere</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Snowridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Penryn</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G5</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G4</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G1</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Rome</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Milan</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Dhyana</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cooperlake</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Conroe</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>486</model>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:   </cpu>
Jul 27 09:26:07 user nova-compute[70374]:   <memoryBacking supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='sourceType'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>file</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>anonymous</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>memfd</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:   </memoryBacking>
Jul 27 09:26:07 user nova-compute[70374]:   <devices>
Jul 27 09:26:07 user nova-compute[70374]:     <disk supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='diskDevice'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>disk</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cdrom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>floppy</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>lun</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='bus'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ide</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>fdc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sata</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </disk>
Jul 27 09:26:07 user nova-compute[70374]:     <graphics supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sdl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vnc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>spice</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egl-headless</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </graphics>
Jul 27 09:26:07 user nova-compute[70374]:     <video supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='modelType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cirrus</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vmvga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>qxl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>none</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>bochs</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ramfb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </video>
Jul 27 09:26:07 user nova-compute[70374]:     <hostdev supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='mode'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>subsystem</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='startupPolicy'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>default</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>mandatory</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>requisite</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>optional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='subsysType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pci</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='capsType'/>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='pciBackend'/>
Jul 27 09:26:07 user nova-compute[70374]:     </hostdev>
Jul 27 09:26:07 user nova-compute[70374]:     <rng supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>random</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egd</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>builtin</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </rng>
Jul 27 09:26:07 user nova-compute[70374]:     <filesystem supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='driverType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>path</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>handle</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtiofs</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </filesystem>
Jul 27 09:26:07 user nova-compute[70374]:     <tpm supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-tis</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-crb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>passthrough</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>emulator</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </tpm>
Jul 27 09:26:07 user nova-compute[70374]:   </devices>
Jul 27 09:26:07 user nova-compute[70374]:   <features>
Jul 27 09:26:07 user nova-compute[70374]:     <gic supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <vmcoreinfo supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <genid supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backingStoreInput supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backup supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <sev supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:   </features>
Jul 27 09:26:07 user nova-compute[70374]: </domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 27 09:26:07 user nova-compute[70374]: <domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 09:26:07 user nova-compute[70374]:   <domain>kvm</domain>
Jul 27 09:26:07 user nova-compute[70374]:   <machine>pc-q35-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:   <arch>x86_64</arch>
Jul 27 09:26:07 user nova-compute[70374]:   <vcpu max='288'/>
Jul 27 09:26:07 user nova-compute[70374]:   <iothreads supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:   <os supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='firmware'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>efi</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:     <loader supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>rom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pflash</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='readonly'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='secure'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </loader>
Jul 27 09:26:07 user nova-compute[70374]:   </os>
Jul 27 09:26:07 user nova-compute[70374]:   <cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-passthrough' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='hostPassthroughMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='maximum' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='maximumMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-model' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='umip'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='invtsc'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibpb'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibrs'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='rsba'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='erms'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='custom' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>qemu64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>qemu32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>phenom</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>n270</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>coreduo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>core2duo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>athlon</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Westmere</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Snowridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Penryn</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G5</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G4</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Opteron_G1</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Rome</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Milan</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Dhyana</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cooperlake</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Conroe</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>486</model>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:   </cpu>
Jul 27 09:26:07 user nova-compute[70374]:   <memoryBacking supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='sourceType'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>file</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>anonymous</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>memfd</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:   </memoryBacking>
Jul 27 09:26:07 user nova-compute[70374]:   <devices>
Jul 27 09:26:07 user nova-compute[70374]:     <disk supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='diskDevice'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>disk</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cdrom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>floppy</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>lun</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='bus'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>fdc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sata</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </disk>
Jul 27 09:26:07 user nova-compute[70374]:     <graphics supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sdl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vnc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>spice</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egl-headless</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </graphics>
Jul 27 09:26:07 user nova-compute[70374]:     <video supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='modelType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cirrus</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vmvga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>qxl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>none</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>bochs</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ramfb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </video>
Jul 27 09:26:07 user nova-compute[70374]:     <hostdev supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='mode'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>subsystem</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='startupPolicy'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>default</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>mandatory</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>requisite</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>optional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='subsysType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pci</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='capsType'/>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='pciBackend'/>
Jul 27 09:26:07 user nova-compute[70374]:     </hostdev>
Jul 27 09:26:07 user nova-compute[70374]:     <rng supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>random</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egd</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>builtin</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </rng>
Jul 27 09:26:07 user nova-compute[70374]:     <filesystem supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='driverType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>path</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>handle</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtiofs</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </filesystem>
Jul 27 09:26:07 user nova-compute[70374]:     <tpm supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-tis</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-crb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>passthrough</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>emulator</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </tpm>
Jul 27 09:26:07 user nova-compute[70374]:   </devices>
Jul 27 09:26:07 user nova-compute[70374]:   <features>
Jul 27 09:26:07 user nova-compute[70374]:     <gic supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <vmcoreinfo supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <genid supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backingStoreInput supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backup supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <sev supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:   </features>
Jul 27 09:26:07 user nova-compute[70374]: </domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 27 09:26:07 user nova-compute[70374]: <domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 09:26:07 user nova-compute[70374]:   <domain>kvm</domain>
Jul 27 09:26:07 user nova-compute[70374]:   <machine>pc-i440fx-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:   <arch>x86_64</arch>
Jul 27 09:26:07 user nova-compute[70374]:   <vcpu max='255'/>
Jul 27 09:26:07 user nova-compute[70374]:   <iothreads supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:   <os supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='firmware'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>efi</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:     <loader supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>rom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pflash</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='readonly'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='secure'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </loader>
Jul 27 09:26:07 user nova-compute[70374]:   </os>
Jul 27 09:26:07 user nova-compute[70374]:   <cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-passthrough' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='hostPassthroughMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='maximum' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='maximumMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-model' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='umip'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='invtsc'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibpb'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibrs'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='rsba'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='erms'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='custom' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>qemu64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>qemu32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>phenom</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>n270</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>coreduo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>core2duo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>athlon</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Westmere</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Snowridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Penryn</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G5</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G4</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Opteron_G1</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Rome</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Milan</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Dhyana</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cooperlake</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Conroe</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>486</model>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:   </cpu>
Jul 27 09:26:07 user nova-compute[70374]:   <memoryBacking supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='sourceType'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>file</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>anonymous</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>memfd</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:   </memoryBacking>
Jul 27 09:26:07 user nova-compute[70374]:   <devices>
Jul 27 09:26:07 user nova-compute[70374]:     <disk supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='diskDevice'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>disk</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cdrom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>floppy</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>lun</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='bus'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ide</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>fdc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sata</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </disk>
Jul 27 09:26:07 user nova-compute[70374]:     <graphics supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sdl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vnc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>spice</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egl-headless</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </graphics>
Jul 27 09:26:07 user nova-compute[70374]:     <video supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='modelType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cirrus</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vmvga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>qxl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>none</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>bochs</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ramfb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </video>
Jul 27 09:26:07 user nova-compute[70374]:     <hostdev supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='mode'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>subsystem</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='startupPolicy'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>default</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>mandatory</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>requisite</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>optional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='subsysType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pci</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='capsType'/>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='pciBackend'/>
Jul 27 09:26:07 user nova-compute[70374]:     </hostdev>
Jul 27 09:26:07 user nova-compute[70374]:     <rng supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>random</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egd</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>builtin</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </rng>
Jul 27 09:26:07 user nova-compute[70374]:     <filesystem supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='driverType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>path</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>handle</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtiofs</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </filesystem>
Jul 27 09:26:07 user nova-compute[70374]:     <tpm supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-tis</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-crb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>passthrough</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>emulator</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </tpm>
Jul 27 09:26:07 user nova-compute[70374]:   </devices>
Jul 27 09:26:07 user nova-compute[70374]:   <features>
Jul 27 09:26:07 user nova-compute[70374]:     <gic supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <vmcoreinfo supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <genid supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backingStoreInput supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backup supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <sev supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:   </features>
Jul 27 09:26:07 user nova-compute[70374]: </domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 27 09:26:07 user nova-compute[70374]: <domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 09:26:07 user nova-compute[70374]:   <domain>kvm</domain>
Jul 27 09:26:07 user nova-compute[70374]:   <machine>pc-q35-6.2</machine>
Jul 27 09:26:07 user nova-compute[70374]:   <arch>x86_64</arch>
Jul 27 09:26:07 user nova-compute[70374]:   <vcpu max='288'/>
Jul 27 09:26:07 user nova-compute[70374]:   <iothreads supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:   <os supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='firmware'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>efi</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:     <loader supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>rom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pflash</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='readonly'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='secure'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </loader>
Jul 27 09:26:07 user nova-compute[70374]:   </os>
Jul 27 09:26:07 user nova-compute[70374]:   <cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-passthrough' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='hostPassthroughMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='maximum' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='maximumMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-model' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='umip'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='invtsc'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibpb'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibrs'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='rsba'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='erms'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='custom' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>qemu64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>qemu32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>phenom</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>n270</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>coreduo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>core2duo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>athlon</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Westmere</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Snowridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Penryn</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G5</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G4</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Opteron_G1</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Rome</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Milan</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Dhyana</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cooperlake</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Conroe</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>486</model>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:   </cpu>
Jul 27 09:26:07 user nova-compute[70374]:   <memoryBacking supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='sourceType'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>file</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>anonymous</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>memfd</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:   </memoryBacking>
Jul 27 09:26:07 user nova-compute[70374]:   <devices>
Jul 27 09:26:07 user nova-compute[70374]:     <disk supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='diskDevice'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>disk</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cdrom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>floppy</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>lun</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='bus'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>fdc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sata</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </disk>
Jul 27 09:26:07 user nova-compute[70374]:     <graphics supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sdl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vnc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>spice</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egl-headless</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </graphics>
Jul 27 09:26:07 user nova-compute[70374]:     <video supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='modelType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cirrus</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vmvga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>qxl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>none</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>bochs</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ramfb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </video>
Jul 27 09:26:07 user nova-compute[70374]:     <hostdev supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='mode'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>subsystem</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='startupPolicy'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>default</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>mandatory</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>requisite</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>optional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='subsysType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pci</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='capsType'/>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='pciBackend'/>
Jul 27 09:26:07 user nova-compute[70374]:     </hostdev>
Jul 27 09:26:07 user nova-compute[70374]:     <rng supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>random</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egd</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>builtin</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </rng>
Jul 27 09:26:07 user nova-compute[70374]:     <filesystem supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='driverType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>path</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>handle</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtiofs</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </filesystem>
Jul 27 09:26:07 user nova-compute[70374]:     <tpm supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-tis</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-crb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>passthrough</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>emulator</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </tpm>
Jul 27 09:26:07 user nova-compute[70374]:   </devices>
Jul 27 09:26:07 user nova-compute[70374]:   <features>
Jul 27 09:26:07 user nova-compute[70374]:     <gic supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <vmcoreinfo supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <genid supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backingStoreInput supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backup supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <sev supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:   </features>
Jul 27 09:26:07 user nova-compute[70374]: </domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 27 09:26:07 user nova-compute[70374]: <domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 09:26:07 user nova-compute[70374]:   <domain>kvm</domain>
Jul 27 09:26:07 user nova-compute[70374]:   <machine>pc-i440fx-jammy</machine>
Jul 27 09:26:07 user nova-compute[70374]:   <arch>x86_64</arch>
Jul 27 09:26:07 user nova-compute[70374]:   <vcpu max='255'/>
Jul 27 09:26:07 user nova-compute[70374]:   <iothreads supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:   <os supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='firmware'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>efi</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:     <loader supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>rom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pflash</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='readonly'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>yes</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='secure'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>no</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </loader>
Jul 27 09:26:07 user nova-compute[70374]:   </os>
Jul 27 09:26:07 user nova-compute[70374]:   <cpu>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-passthrough' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='hostPassthroughMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='maximum' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='maximumMigratable'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>on</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>off</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='host-model' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <vendor>Intel</vendor>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ss'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='vmx'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pcid'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='hypervisor'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arat'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='umip'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='md-clear'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='invtsc'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibpb'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='ibrs'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-stibp'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='rsba'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='erms'/>
Jul 27 09:26:07 user nova-compute[70374]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:     <mode name='custom' supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>qemu64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>qemu32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>phenom</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>pentium</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>n270</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm64</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>kvm32</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>coreduo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>core2duo</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>athlon</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Westmere</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Snowridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Skylake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>SandyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Penryn</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G5</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G4</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G3</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Opteron_G2</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Opteron_G1</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>IvyBridge</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Icelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Haswell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Rome</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-Milan</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>EPYC</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Dhyana</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cooperlake</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>Conroe</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='no'>Broadwell</model>
Jul 27 09:26:07 user nova-compute[70374]:       <model usable='yes'>486</model>
Jul 27 09:26:07 user nova-compute[70374]:     </mode>
Jul 27 09:26:07 user nova-compute[70374]:   </cpu>
Jul 27 09:26:07 user nova-compute[70374]:   <memoryBacking supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:     <enum name='sourceType'>
Jul 27 09:26:07 user nova-compute[70374]:       <value>file</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>anonymous</value>
Jul 27 09:26:07 user nova-compute[70374]:       <value>memfd</value>
Jul 27 09:26:07 user nova-compute[70374]:     </enum>
Jul 27 09:26:07 user nova-compute[70374]:   </memoryBacking>
Jul 27 09:26:07 user nova-compute[70374]:   <devices>
Jul 27 09:26:07 user nova-compute[70374]:     <disk supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='diskDevice'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>disk</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cdrom</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>floppy</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>lun</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='bus'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ide</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>fdc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sata</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </disk>
Jul 27 09:26:07 user nova-compute[70374]:     <graphics supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='type'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>sdl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vnc</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>spice</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egl-headless</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </graphics>
Jul 27 09:26:07 user nova-compute[70374]:     <video supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='modelType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>cirrus</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>vmvga</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>qxl</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>none</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>bochs</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>ramfb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </video>
Jul 27 09:26:07 user nova-compute[70374]:     <hostdev supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='mode'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>subsystem</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='startupPolicy'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>default</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>mandatory</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>requisite</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>optional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='subsysType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>usb</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>pci</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>scsi</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='capsType'/>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='pciBackend'/>
Jul 27 09:26:07 user nova-compute[70374]:     </hostdev>
Jul 27 09:26:07 user nova-compute[70374]:     <rng supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtio-non-transitional</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>random</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>egd</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>builtin</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </rng>
Jul 27 09:26:07 user nova-compute[70374]:     <filesystem supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='driverType'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>path</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>handle</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>virtiofs</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </filesystem>
Jul 27 09:26:07 user nova-compute[70374]:     <tpm supported='yes'>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='model'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-tis</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>tpm-crb</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:       <enum name='backendModel'>
Jul 27 09:26:07 user nova-compute[70374]:         <value>passthrough</value>
Jul 27 09:26:07 user nova-compute[70374]:         <value>emulator</value>
Jul 27 09:26:07 user nova-compute[70374]:       </enum>
Jul 27 09:26:07 user nova-compute[70374]:     </tpm>
Jul 27 09:26:07 user nova-compute[70374]:   </devices>
Jul 27 09:26:07 user nova-compute[70374]:   <features>
Jul 27 09:26:07 user nova-compute[70374]:     <gic supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:     <vmcoreinfo supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <genid supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backingStoreInput supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <backup supported='yes'/>
Jul 27 09:26:07 user nova-compute[70374]:     <sev supported='no'/>
Jul 27 09:26:07 user nova-compute[70374]:   </features>
Jul 27 09:26:07 user nova-compute[70374]: </domainCapabilities>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70374) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70374) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Checking secure boot support for host arch (x86_64) {{(pid=70374) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 09:26:07 user nova-compute[70374]: INFO nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Secure Boot support detected
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] cpu compare xml: <cpu match="exact">
Jul 27 09:26:07 user nova-compute[70374]:   <model>Nehalem</model>
Jul 27 09:26:07 user nova-compute[70374]: </cpu>
Jul 27 09:26:07 user nova-compute[70374]:  {{(pid=70374) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 27 09:26:07 user nova-compute[70374]: INFO nova.virt.node [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Generated node identity f7548644-4a09-4ad8-9aa6-6e05d85a9f5b
Jul 27 09:26:07 user nova-compute[70374]: INFO nova.virt.node [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Wrote node identity f7548644-4a09-4ad8-9aa6-6e05d85a9f5b to /opt/stack/data/nova/compute_id
Jul 27 09:26:07 user nova-compute[70374]: WARNING nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Compute nodes ['f7548644-4a09-4ad8-9aa6-6e05d85a9f5b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 27 09:26:07 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 27 09:26:07 user nova-compute[70374]: WARNING nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 09:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:26:07 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:26:07 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Hypervisor/Node resource view: name=user free_ram=10932MB free_disk=26.33572769165039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:26:07 user nova-compute[70374]: WARNING nova.compute.resource_tracker [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] No compute node record for user:f7548644-4a09-4ad8-9aa6-6e05d85a9f5b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f7548644-4a09-4ad8-9aa6-6e05d85a9f5b could not be found.
Jul 27 09:26:07 user nova-compute[70374]: INFO nova.compute.resource_tracker [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Compute node record created for user:user with uuid: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:26:07 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:26:08 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [req-44b37c6f-6944-449c-9293-bee6b180e7f2] Created resource provider record via placement API for resource provider with UUID f7548644-4a09-4ad8-9aa6-6e05d85a9f5b and name user.
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70374) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 27 09:26:08 user nova-compute[70374]: INFO nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] kernel doesn't support AMD SEV
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Libvirt baseline CPU <cpu>
Jul 27 09:26:08 user nova-compute[70374]:   <arch>x86_64</arch>
Jul 27 09:26:08 user nova-compute[70374]:   <model>Nehalem</model>
Jul 27 09:26:08 user nova-compute[70374]:   <vendor>Intel</vendor>
Jul 27 09:26:08 user nova-compute[70374]:   <topology sockets="6" cores="1" threads="1"/>
Jul 27 09:26:08 user nova-compute[70374]: </cpu>
Jul 27 09:26:08 user nova-compute[70374]:  {{(pid=70374) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Updated inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Updating resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b generation from 0 to 1 during operation: update_inventory {{(pid=70374) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Updating resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b generation from 1 to 2 during operation: update_traits {{(pid=70374) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.service [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Creating RPC server for service compute {{(pid=70374) start /opt/stack/nova/nova/service.py:182}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.service [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Join ServiceGroup membership for this service compute {{(pid=70374) start /opt/stack/nova/nova/service.py:199}}
Jul 27 09:26:08 user nova-compute[70374]: DEBUG nova.servicegroup.drivers.db [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70374) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 27 09:26:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_power_states {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:26:59 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:26:59 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=10324MB free_disk=26.239673614501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:26:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:27:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:27:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:27:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:27:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:27:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:27:59 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:28:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:28:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=10282MB free_disk=26.284893035888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:28:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:28:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:28:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:28:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:29:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:29:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 09:29:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:29:01 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:29:01 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:29:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=10264MB free_disk=26.058773040771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:29:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:29:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:30:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:30:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 09:30:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:30:02 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:02 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=9513MB free_disk=26.08094024658203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:30:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:04 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:06 user nova-compute[70374]: INFO nova.compute.claims [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Claim successful on node user
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:07 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:07 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Creating image(s)
Jul 27 09:30:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "/opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "/opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "/opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:07 user nova-compute[70374]: DEBUG nova.policy [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '544aa4a40ff941c2a52b24faa08a0d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e935bb36794aa98eb3e94c30e647d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1.part --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:08 user nova-compute[70374]: DEBUG nova.virt.images [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] 35458adf-261a-4e0b-a4db-b243619b2394 was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:30:08 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:30:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1.part /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1.part /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1.converted" returned: 0 in 0.179s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.359s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:09 user nova-compute[70374]: INFO oslo.privsep.daemon [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjix27fxf/privsep.sock']
Jul 27 09:30:09 user sudo[79508]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjix27fxf/privsep.sock
Jul 27 09:30:09 user sudo[79508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 09:30:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:09 user nova-compute[70374]: INFO nova.compute.claims [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Claim successful on node user
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:10 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:10 user sudo[79508]: pam_unix(sudo:session): session closed for user root
Jul 27 09:30:10 user nova-compute[70374]: INFO oslo.privsep.daemon [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Spawned new privsep daemon via rootwrap
Jul 27 09:30:10 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 09:30:10 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 09:30:10 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 27 09:30:10 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79521
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Successfully created port: 6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:10 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Creating image(s)
Jul 27 09:30:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.159s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk 1073741824" returned: 0 in 0.086s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.216s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.policy [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd059c8dff3644f3c9c0c54498a4d78f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8acda82ef3f428fbb93847922a213d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.221s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk 1073741824" returned: 0 in 0.078s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Cannot resize image /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lazy-loading 'migration_context' on Instance uuid 04a990b9-ed32-41e9-b384-f0886e8d1b49 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Ensure instance console log exists: /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Cannot resize image /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.objects.instance [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'migration_context' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Ensure instance console log exists: /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:12 user nova-compute[70374]: INFO nova.compute.claims [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Claim successful on node user
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.311s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:12 user nova-compute[70374]: INFO nova.compute.claims [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Claim successful on node user
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.network.neutron [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:12 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:12 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Creating image(s)
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "/opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "/opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.network.neutron [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.policy [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c87590f95d1147f48a94203d8be751ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99bef1aeee4c6090e60bdbb0ecbeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:13 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk 1073741824" returned: 0 in 0.056s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:13 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Creating image(s)
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Successfully updated port: 6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.policy [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd059c8dff3644f3c9c0c54498a4d78f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8acda82ef3f428fbb93847922a213d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquired lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Cannot resize image /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.objects.instance [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lazy-loading 'migration_context' on Instance uuid 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Ensure instance console log exists: /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk 1073741824" returned: 0 in 0.052s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG nova.compute.manager [req-830af63e-4980-4c98-9db6-28b5819a706e req-0aacd555-0d49-4fb5-8d52-d132fad9c415 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received event network-changed-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG nova.compute.manager [req-830af63e-4980-4c98-9db6-28b5819a706e req-0aacd555-0d49-4fb5-8d52-d132fad9c415 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Refreshing instance network info cache due to event network-changed-6858719a-7fa4-4a64-ad8a-02c9274adb55. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-830af63e-4980-4c98-9db6-28b5819a706e req-0aacd555-0d49-4fb5-8d52-d132fad9c415 service nova] Acquiring lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Cannot resize image /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG nova.objects.instance [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'migration_context' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Ensure instance console log exists: /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:14 user nova-compute[70374]: DEBUG nova.network.neutron [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Successfully created port: fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updating instance_info_cache with network_info: [{"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Releasing lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Instance network_info: |[{"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-830af63e-4980-4c98-9db6-28b5819a706e req-0aacd555-0d49-4fb5-8d52-d132fad9c415 service nova] Acquired lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.network.neutron [req-830af63e-4980-4c98-9db6-28b5819a706e req-0aacd555-0d49-4fb5-8d52-d132fad9c415 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Refreshing network info cache for port 6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Start _get_guest_xml network_info=[{"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:15 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:15 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-503176185',display_name='tempest-ServersNegativeTestJSON-server-503176185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-503176185',id=1,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65e935bb36794aa98eb3e94c30e647d9',ramdisk_id='',reservation_id='r-xsrj9cxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1865798359',owner_user_name='tempest-ServersNegativeTestJSON-1865798359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:08Z,user_data=None,user_id='544aa4a40ff941c2a52b24faa08a0d29',uuid=04a990b9-ed32-41e9-b384-f0886e8d1b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converting VIF {"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e0:42,bridge_name='br-int',has_traffic_filtering=True,id=6858719a-7fa4-4a64-ad8a-02c9274adb55,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6858719a-7f') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lazy-loading 'pci_devices' on Instance uuid 04a990b9-ed32-41e9-b384-f0886e8d1b49 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:15 user nova-compute[70374]:   <uuid>04a990b9-ed32-41e9-b384-f0886e8d1b49</uuid>
Jul 27 09:30:15 user nova-compute[70374]:   <name>instance-00000001</name>
Jul 27 09:30:15 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:15 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:15 user nova-compute[70374]:   <metadata>
Jul 27 09:30:15 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:15 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:15 user nova-compute[70374]:       <nova:name>tempest-ServersNegativeTestJSON-server-503176185</nova:name>
Jul 27 09:30:15 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:15</nova:creationTime>
Jul 27 09:30:15 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:15 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:15 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:15 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:15 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:15 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:15 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:15 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:15 user nova-compute[70374]:         <nova:user uuid="544aa4a40ff941c2a52b24faa08a0d29">tempest-ServersNegativeTestJSON-1865798359-project-member</nova:user>
Jul 27 09:30:15 user nova-compute[70374]:         <nova:project uuid="65e935bb36794aa98eb3e94c30e647d9">tempest-ServersNegativeTestJSON-1865798359</nova:project>
Jul 27 09:30:15 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:15 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:15 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:15 user nova-compute[70374]:         <nova:port uuid="6858719a-7fa4-4a64-ad8a-02c9274adb55">
Jul 27 09:30:15 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 09:30:15 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:15 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:15 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:15 user nova-compute[70374]:   </metadata>
Jul 27 09:30:15 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:15 user nova-compute[70374]:     <system>
Jul 27 09:30:15 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:15 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:15 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:15 user nova-compute[70374]:       <entry name="serial">04a990b9-ed32-41e9-b384-f0886e8d1b49</entry>
Jul 27 09:30:15 user nova-compute[70374]:       <entry name="uuid">04a990b9-ed32-41e9-b384-f0886e8d1b49</entry>
Jul 27 09:30:15 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:15 user nova-compute[70374]:     </system>
Jul 27 09:30:15 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:15 user nova-compute[70374]:   <os>
Jul 27 09:30:15 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:15 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:15 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:15 user nova-compute[70374]:   </os>
Jul 27 09:30:15 user nova-compute[70374]:   <features>
Jul 27 09:30:15 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:15 user nova-compute[70374]:     <apic/>
Jul 27 09:30:15 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:15 user nova-compute[70374]:   </features>
Jul 27 09:30:15 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:15 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:15 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:15 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:15 user nova-compute[70374]:   </clock>
Jul 27 09:30:15 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:15 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:15 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:15 user nova-compute[70374]:   </cpu>
Jul 27 09:30:15 user nova-compute[70374]:   <devices>
Jul 27 09:30:15 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:15 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:15 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk"/>
Jul 27 09:30:15 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:15 user nova-compute[70374]:     </disk>
Jul 27 09:30:15 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:15 user nova-compute[70374]:       <mac address="fa:16:3e:e6:e0:42"/>
Jul 27 09:30:15 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:15 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:15 user nova-compute[70374]:       <target dev="tap6858719a-7f"/>
Jul 27 09:30:15 user nova-compute[70374]:     </interface>
Jul 27 09:30:15 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:15 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/console.log" append="off"/>
Jul 27 09:30:15 user nova-compute[70374]:     </serial>
Jul 27 09:30:15 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:15 user nova-compute[70374]:     <video>
Jul 27 09:30:15 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:15 user nova-compute[70374]:     </video>
Jul 27 09:30:15 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:15 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:15 user nova-compute[70374]:     </rng>
Jul 27 09:30:15 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:15 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:15 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:15 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:15 user nova-compute[70374]:   </devices>
Jul 27 09:30:15 user nova-compute[70374]: </domain>
Jul 27 09:30:15 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-503176185',display_name='tempest-ServersNegativeTestJSON-server-503176185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-503176185',id=1,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65e935bb36794aa98eb3e94c30e647d9',ramdisk_id='',reservation_id='r-xsrj9cxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1865798359',owner_user_name='tempest-ServersNegativeTestJSON-1865798359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:08Z,user_data=None,user_id='544aa4a40ff941c2a52b24faa08a0d29',uuid=04a990b9-ed32-41e9-b384-f0886e8d1b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converting VIF {"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e0:42,bridge_name='br-int',has_traffic_filtering=True,id=6858719a-7fa4-4a64-ad8a-02c9274adb55,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6858719a-7f') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG os_vif [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e0:42,bridge_name='br-int',has_traffic_filtering=True,id=6858719a-7fa4-4a64-ad8a-02c9274adb55,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6858719a-7f') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Created schema index Interface.name {{(pid=70374) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Created schema index Port.name {{(pid=70374) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Created schema index Bridge.name {{(pid=70374) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [POLLOUT] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:15 user nova-compute[70374]: INFO nova.compute.claims [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Claim successful on node user
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:15 user nova-compute[70374]: INFO oslo.privsep.daemon [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp9y63cp12/privsep.sock']
Jul 27 09:30:15 user sudo[79592]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp9y63cp12/privsep.sock
Jul 27 09:30:15 user sudo[79592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.network.neutron [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Successfully created port: 98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:15 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:16 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Creating image(s)
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "/opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "/opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "/opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.policy [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c1d49c23b0045d881d9f47e33447162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaa69b3745a435795aa636ccddec3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk 1073741824" returned: 0 in 0.062s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.network.neutron [req-830af63e-4980-4c98-9db6-28b5819a706e req-0aacd555-0d49-4fb5-8d52-d132fad9c415 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updated VIF entry in instance network info cache for port 6858719a-7fa4-4a64-ad8a-02c9274adb55. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.network.neutron [req-830af63e-4980-4c98-9db6-28b5819a706e req-0aacd555-0d49-4fb5-8d52-d132fad9c415 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updating instance_info_cache with network_info: [{"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-830af63e-4980-4c98-9db6-28b5819a706e req-0aacd555-0d49-4fb5-8d52-d132fad9c415 service nova] Releasing lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.network.neutron [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Successfully created port: ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:16 user nova-compute[70374]: INFO nova.compute.claims [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Claim successful on node user
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Cannot resize image /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'migration_context' on Instance uuid 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Ensure instance console log exists: /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:16 user sudo[79592]: pam_unix(sudo:session): session closed for user root
Jul 27 09:30:16 user nova-compute[70374]: INFO oslo.privsep.daemon [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Spawned new privsep daemon via rootwrap
Jul 27 09:30:16 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 09:30:16 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 09:30:16 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 27 09:30:16 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79611
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.network.neutron [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Successfully updated port: 98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "refresh_cache-6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquired lock "refresh_cache-6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.network.neutron [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-2bf1a339-43ce-4d5c-ac03-cf923f486ace req-c8843656-4cf7-4a3a-a9cb-845eccbe7e9e service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received event network-changed-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-2bf1a339-43ce-4d5c-ac03-cf923f486ace req-c8843656-4cf7-4a3a-a9cb-845eccbe7e9e service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Refreshing instance network info cache due to event network-changed-98a9819c-4270-4b75-b851-635a3b19a7b4. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2bf1a339-43ce-4d5c-ac03-cf923f486ace req-c8843656-4cf7-4a3a-a9cb-845eccbe7e9e service nova] Acquiring lock "refresh_cache-6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.network.neutron [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.network.neutron [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:17 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:17 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Creating image(s)
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6858719a-7f, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6858719a-7f, col_values=(('external_ids', {'iface-id': '6858719a-7fa4-4a64-ad8a-02c9274adb55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:e0:42', 'vm-uuid': '04a990b9-ed32-41e9-b384-f0886e8d1b49'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:17 user nova-compute[70374]: INFO os_vif [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e0:42,bridge_name='br-int',has_traffic_filtering=True,id=6858719a-7fa4-4a64-ad8a-02c9274adb55,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6858719a-7f')
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.policy [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d4c5ec795ee4d3387ce8718d2ac67e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0592f0be670742a181e24823955f378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] No VIF found with MAC fa:16:3e:e6:e0:42, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.119s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk 1073741824" returned: 0 in 0.055s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.188s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Successfully created port: e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Updating instance_info_cache with network_info: [{"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Cannot resize image /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'migration_context' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Ensure instance console log exists: /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Releasing lock "refresh_cache-6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Instance network_info: |[{"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2bf1a339-43ce-4d5c-ac03-cf923f486ace req-c8843656-4cf7-4a3a-a9cb-845eccbe7e9e service nova] Acquired lock "refresh_cache-6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.neutron [req-2bf1a339-43ce-4d5c-ac03-cf923f486ace req-c8843656-4cf7-4a3a-a9cb-845eccbe7e9e service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Refreshing network info cache for port 98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Start _get_guest_xml network_info=[{"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:18 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:18 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1737227100',display_name='tempest-DeleteServersTestJSON-server-1737227100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1737227100',id=3,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d99bef1aeee4c6090e60bdbb0ecbeda',ramdisk_id='',reservation_id='r-vup3cqqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-322957873',owner_user_name='tempest-DeleteServersTestJSON-322957873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:13Z,user_data=None,user_id='c87590f95d1147f48a94203d8be751ab',uuid=6a5593cd-3ab6-4859-b0fb-33a0ed702dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Converting VIF {"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:c0,bridge_name='br-int',has_traffic_filtering=True,id=98a9819c-4270-4b75-b851-635a3b19a7b4,network=Network(6faafed3-97ab-43b5-bf25-0d0a468935f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a9819c-42') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:18 user nova-compute[70374]:   <uuid>6a5593cd-3ab6-4859-b0fb-33a0ed702dc8</uuid>
Jul 27 09:30:18 user nova-compute[70374]:   <name>instance-00000003</name>
Jul 27 09:30:18 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:18 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:18 user nova-compute[70374]:   <metadata>
Jul 27 09:30:18 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:18 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:18 user nova-compute[70374]:       <nova:name>tempest-DeleteServersTestJSON-server-1737227100</nova:name>
Jul 27 09:30:18 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:18</nova:creationTime>
Jul 27 09:30:18 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:18 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:18 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:18 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:18 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:18 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:18 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:18 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:18 user nova-compute[70374]:         <nova:user uuid="c87590f95d1147f48a94203d8be751ab">tempest-DeleteServersTestJSON-322957873-project-member</nova:user>
Jul 27 09:30:18 user nova-compute[70374]:         <nova:project uuid="0d99bef1aeee4c6090e60bdbb0ecbeda">tempest-DeleteServersTestJSON-322957873</nova:project>
Jul 27 09:30:18 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:18 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:18 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:18 user nova-compute[70374]:         <nova:port uuid="98a9819c-4270-4b75-b851-635a3b19a7b4">
Jul 27 09:30:18 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 09:30:18 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:18 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:18 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:18 user nova-compute[70374]:   </metadata>
Jul 27 09:30:18 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:18 user nova-compute[70374]:     <system>
Jul 27 09:30:18 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:18 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:18 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:18 user nova-compute[70374]:       <entry name="serial">6a5593cd-3ab6-4859-b0fb-33a0ed702dc8</entry>
Jul 27 09:30:18 user nova-compute[70374]:       <entry name="uuid">6a5593cd-3ab6-4859-b0fb-33a0ed702dc8</entry>
Jul 27 09:30:18 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:18 user nova-compute[70374]:     </system>
Jul 27 09:30:18 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:18 user nova-compute[70374]:   <os>
Jul 27 09:30:18 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:18 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:18 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:18 user nova-compute[70374]:   </os>
Jul 27 09:30:18 user nova-compute[70374]:   <features>
Jul 27 09:30:18 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:18 user nova-compute[70374]:     <apic/>
Jul 27 09:30:18 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:18 user nova-compute[70374]:   </features>
Jul 27 09:30:18 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:18 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:18 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:18 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:18 user nova-compute[70374]:   </clock>
Jul 27 09:30:18 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:18 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:18 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:18 user nova-compute[70374]:   </cpu>
Jul 27 09:30:18 user nova-compute[70374]:   <devices>
Jul 27 09:30:18 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:18 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:18 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk"/>
Jul 27 09:30:18 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:18 user nova-compute[70374]:     </disk>
Jul 27 09:30:18 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:18 user nova-compute[70374]:       <mac address="fa:16:3e:de:fb:c0"/>
Jul 27 09:30:18 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:18 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:18 user nova-compute[70374]:       <target dev="tap98a9819c-42"/>
Jul 27 09:30:18 user nova-compute[70374]:     </interface>
Jul 27 09:30:18 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:18 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/console.log" append="off"/>
Jul 27 09:30:18 user nova-compute[70374]:     </serial>
Jul 27 09:30:18 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:18 user nova-compute[70374]:     <video>
Jul 27 09:30:18 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:18 user nova-compute[70374]:     </video>
Jul 27 09:30:18 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:18 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:18 user nova-compute[70374]:     </rng>
Jul 27 09:30:18 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:18 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:18 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:18 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:18 user nova-compute[70374]:   </devices>
Jul 27 09:30:18 user nova-compute[70374]: </domain>
Jul 27 09:30:18 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1737227100',display_name='tempest-DeleteServersTestJSON-server-1737227100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1737227100',id=3,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d99bef1aeee4c6090e60bdbb0ecbeda',ramdisk_id='',reservation_id='r-vup3cqqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-322957873',owner_user_name='tempest-DeleteServersTestJSON-322957873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:13Z,user_data=None,user_id='c87590f95d1147f48a94203d8be751ab',uuid=6a5593cd-3ab6-4859-b0fb-33a0ed702dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Converting VIF {"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:c0,bridge_name='br-int',has_traffic_filtering=True,id=98a9819c-4270-4b75-b851-635a3b19a7b4,network=Network(6faafed3-97ab-43b5-bf25-0d0a468935f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a9819c-42') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG os_vif [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:c0,bridge_name='br-int',has_traffic_filtering=True,id=98a9819c-4270-4b75-b851-635a3b19a7b4,network=Network(6faafed3-97ab-43b5-bf25-0d0a468935f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a9819c-42') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98a9819c-42, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98a9819c-42, col_values=(('external_ids', {'iface-id': '98a9819c-4270-4b75-b851-635a3b19a7b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:fb:c0', 'vm-uuid': '6a5593cd-3ab6-4859-b0fb-33a0ed702dc8'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:18 user nova-compute[70374]: INFO os_vif [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:c0,bridge_name='br-int',has_traffic_filtering=True,id=98a9819c-4270-4b75-b851-635a3b19a7b4,network=Network(6faafed3-97ab-43b5-bf25-0d0a468935f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a9819c-42')
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] No VIF found with MAC fa:16:3e:de:fb:c0, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Successfully updated port: fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquired lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-eb38fdd4-8a1b-4d35-9f46-904a861b2f22 req-96424af7-e05d-4f97-bd1a-c30984cfd118 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-changed-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-eb38fdd4-8a1b-4d35-9f46-904a861b2f22 req-96424af7-e05d-4f97-bd1a-c30984cfd118 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Refreshing instance network info cache due to event network-changed-fd47b104-c8ff-4b76-8f3a-53725f9f318c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eb38fdd4-8a1b-4d35-9f46-904a861b2f22 req-96424af7-e05d-4f97-bd1a-c30984cfd118 service nova] Acquiring lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Successfully updated port: ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquired lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-a765d3c0-bbef-48fa-b350-6a518a5ea414 req-28e37a0c-07b4-407a-bf17-9ba09dabc2e4 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-changed-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-a765d3c0-bbef-48fa-b350-6a518a5ea414 req-28e37a0c-07b4-407a-bf17-9ba09dabc2e4 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Refreshing instance network info cache due to event network-changed-ce2809b5-cc30-4a29-9770-7df186b16406. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a765d3c0-bbef-48fa-b350-6a518a5ea414 req-28e37a0c-07b4-407a-bf17-9ba09dabc2e4 service nova] Acquiring lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.neutron [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Releasing lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance network_info: |[{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eb38fdd4-8a1b-4d35-9f46-904a861b2f22 req-96424af7-e05d-4f97-bd1a-c30984cfd118 service nova] Acquired lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.neutron [req-eb38fdd4-8a1b-4d35-9f46-904a861b2f22 req-96424af7-e05d-4f97-bd1a-c30984cfd118 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Refreshing network info cache for port fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Start _get_guest_xml network_info=[{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:20 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:20 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2041850193',display_name='tempest-ServerRescueNegativeTestJSON-server-2041850193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2041850193',id=2,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-44a0z2kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:11Z,user_data=None,user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=fb5ccac9-1e45-4726-b681-cf34cf3fa521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=fd47b104-c8ff-4b76-8f3a-53725f9f318c,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47b104-c8') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'pci_devices' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:20 user nova-compute[70374]:   <uuid>fb5ccac9-1e45-4726-b681-cf34cf3fa521</uuid>
Jul 27 09:30:20 user nova-compute[70374]:   <name>instance-00000002</name>
Jul 27 09:30:20 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:20 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:20 user nova-compute[70374]:   <metadata>
Jul 27 09:30:20 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:20 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:20 user nova-compute[70374]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2041850193</nova:name>
Jul 27 09:30:20 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:20</nova:creationTime>
Jul 27 09:30:20 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:20 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:20 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:20 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:20 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:20 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:20 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:20 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:20 user nova-compute[70374]:         <nova:user uuid="d059c8dff3644f3c9c0c54498a4d78f7">tempest-ServerRescueNegativeTestJSON-241559119-project-member</nova:user>
Jul 27 09:30:20 user nova-compute[70374]:         <nova:project uuid="d8acda82ef3f428fbb93847922a213d1">tempest-ServerRescueNegativeTestJSON-241559119</nova:project>
Jul 27 09:30:20 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:20 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:20 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:20 user nova-compute[70374]:         <nova:port uuid="fd47b104-c8ff-4b76-8f3a-53725f9f318c">
Jul 27 09:30:20 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 09:30:20 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:20 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:20 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:20 user nova-compute[70374]:   </metadata>
Jul 27 09:30:20 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:20 user nova-compute[70374]:     <system>
Jul 27 09:30:20 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:20 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:20 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:20 user nova-compute[70374]:       <entry name="serial">fb5ccac9-1e45-4726-b681-cf34cf3fa521</entry>
Jul 27 09:30:20 user nova-compute[70374]:       <entry name="uuid">fb5ccac9-1e45-4726-b681-cf34cf3fa521</entry>
Jul 27 09:30:20 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:20 user nova-compute[70374]:     </system>
Jul 27 09:30:20 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:20 user nova-compute[70374]:   <os>
Jul 27 09:30:20 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:20 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:20 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:20 user nova-compute[70374]:   </os>
Jul 27 09:30:20 user nova-compute[70374]:   <features>
Jul 27 09:30:20 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:20 user nova-compute[70374]:     <apic/>
Jul 27 09:30:20 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:20 user nova-compute[70374]:   </features>
Jul 27 09:30:20 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:20 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:20 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:20 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:20 user nova-compute[70374]:   </clock>
Jul 27 09:30:20 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:20 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:20 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:20 user nova-compute[70374]:   </cpu>
Jul 27 09:30:20 user nova-compute[70374]:   <devices>
Jul 27 09:30:20 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:20 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:20 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk"/>
Jul 27 09:30:20 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:20 user nova-compute[70374]:     </disk>
Jul 27 09:30:20 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:20 user nova-compute[70374]:       <mac address="fa:16:3e:57:cb:7b"/>
Jul 27 09:30:20 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:20 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:20 user nova-compute[70374]:       <target dev="tapfd47b104-c8"/>
Jul 27 09:30:20 user nova-compute[70374]:     </interface>
Jul 27 09:30:20 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:20 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/console.log" append="off"/>
Jul 27 09:30:20 user nova-compute[70374]:     </serial>
Jul 27 09:30:20 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:20 user nova-compute[70374]:     <video>
Jul 27 09:30:20 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:20 user nova-compute[70374]:     </video>
Jul 27 09:30:20 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:20 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:20 user nova-compute[70374]:     </rng>
Jul 27 09:30:20 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:20 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:20 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:20 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:20 user nova-compute[70374]:   </devices>
Jul 27 09:30:20 user nova-compute[70374]: </domain>
Jul 27 09:30:20 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2041850193',display_name='tempest-ServerRescueNegativeTestJSON-server-2041850193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2041850193',id=2,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-44a0z2kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:11Z,user_data=None,user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=fb5ccac9-1e45-4726-b681-cf34cf3fa521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=fd47b104-c8ff-4b76-8f3a-53725f9f318c,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47b104-c8') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG os_vif [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=fd47b104-c8ff-4b76-8f3a-53725f9f318c,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47b104-c8') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd47b104-c8, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd47b104-c8, col_values=(('external_ids', {'iface-id': 'fd47b104-c8ff-4b76-8f3a-53725f9f318c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:cb:7b', 'vm-uuid': 'fb5ccac9-1e45-4726-b681-cf34cf3fa521'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:20 user nova-compute[70374]: INFO os_vif [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=fd47b104-c8ff-4b76-8f3a-53725f9f318c,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47b104-c8')
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.neutron [req-2bf1a339-43ce-4d5c-ac03-cf923f486ace req-c8843656-4cf7-4a3a-a9cb-845eccbe7e9e service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Updated VIF entry in instance network info cache for port 98a9819c-4270-4b75-b851-635a3b19a7b4. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.neutron [req-2bf1a339-43ce-4d5c-ac03-cf923f486ace req-c8843656-4cf7-4a3a-a9cb-845eccbe7e9e service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Updating instance_info_cache with network_info: [{"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2bf1a339-43ce-4d5c-ac03-cf923f486ace req-c8843656-4cf7-4a3a-a9cb-845eccbe7e9e service nova] Releasing lock "refresh_cache-6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No VIF found with MAC fa:16:3e:57:cb:7b, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG nova.network.neutron [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Successfully created port: b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-237e5cea-74df-4e12-9b83-39a6c4bb25bc req-778fa801-d737-4df4-abd6-68a114e18420 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received event network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-237e5cea-74df-4e12-9b83-39a6c4bb25bc req-778fa801-d737-4df4-abd6-68a114e18420 service nova] Acquiring lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-237e5cea-74df-4e12-9b83-39a6c4bb25bc req-778fa801-d737-4df4-abd6-68a114e18420 service nova] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-237e5cea-74df-4e12-9b83-39a6c4bb25bc req-778fa801-d737-4df4-abd6-68a114e18420 service nova] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-237e5cea-74df-4e12-9b83-39a6c4bb25bc req-778fa801-d737-4df4-abd6-68a114e18420 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] No waiting events found dispatching network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:21 user nova-compute[70374]: WARNING nova.compute.manager [req-237e5cea-74df-4e12-9b83-39a6c4bb25bc req-778fa801-d737-4df4-abd6-68a114e18420 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received unexpected event network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 for instance with vm_state building and task_state spawning.
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updating instance_info_cache with network_info: [{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Releasing lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Instance network_info: |[{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a765d3c0-bbef-48fa-b350-6a518a5ea414 req-28e37a0c-07b4-407a-bf17-9ba09dabc2e4 service nova] Acquired lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.neutron [req-a765d3c0-bbef-48fa-b350-6a518a5ea414 req-28e37a0c-07b4-407a-bf17-9ba09dabc2e4 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Refreshing network info cache for port ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Start _get_guest_xml network_info=[{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Successfully updated port: e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:21 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:21 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquired lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457979026',display_name='tempest-ServerRescueNegativeTestJSON-server-1457979026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457979026',id=4,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-x508h1z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:13Z,user_data=None,user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=6ae93f34-ce7e-4ae4-a5ba-36508361bd54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0f:b2,bridge_name='br-int',has_traffic_filtering=True,id=ce2809b5-cc30-4a29-9770-7df186b16406,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2809b5-cc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-05c1b402-a195-437f-ba93-89117886ae9f req-67e1a680-8d9c-4dfa-80eb-4ff95b9abc8c service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-changed-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-05c1b402-a195-437f-ba93-89117886ae9f req-67e1a680-8d9c-4dfa-80eb-4ff95b9abc8c service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Refreshing instance network info cache due to event network-changed-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-05c1b402-a195-437f-ba93-89117886ae9f req-67e1a680-8d9c-4dfa-80eb-4ff95b9abc8c service nova] Acquiring lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:21 user nova-compute[70374]:   <uuid>6ae93f34-ce7e-4ae4-a5ba-36508361bd54</uuid>
Jul 27 09:30:21 user nova-compute[70374]:   <name>instance-00000004</name>
Jul 27 09:30:21 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:21 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:21 user nova-compute[70374]:   <metadata>
Jul 27 09:30:21 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:21 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:21 user nova-compute[70374]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1457979026</nova:name>
Jul 27 09:30:21 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:21</nova:creationTime>
Jul 27 09:30:21 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:21 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:21 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:21 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:21 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:21 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:21 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:21 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:21 user nova-compute[70374]:         <nova:user uuid="d059c8dff3644f3c9c0c54498a4d78f7">tempest-ServerRescueNegativeTestJSON-241559119-project-member</nova:user>
Jul 27 09:30:21 user nova-compute[70374]:         <nova:project uuid="d8acda82ef3f428fbb93847922a213d1">tempest-ServerRescueNegativeTestJSON-241559119</nova:project>
Jul 27 09:30:21 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:21 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:21 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:21 user nova-compute[70374]:         <nova:port uuid="ce2809b5-cc30-4a29-9770-7df186b16406">
Jul 27 09:30:21 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:30:21 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:21 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:21 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:21 user nova-compute[70374]:   </metadata>
Jul 27 09:30:21 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:21 user nova-compute[70374]:     <system>
Jul 27 09:30:21 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:21 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:21 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:21 user nova-compute[70374]:       <entry name="serial">6ae93f34-ce7e-4ae4-a5ba-36508361bd54</entry>
Jul 27 09:30:21 user nova-compute[70374]:       <entry name="uuid">6ae93f34-ce7e-4ae4-a5ba-36508361bd54</entry>
Jul 27 09:30:21 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:21 user nova-compute[70374]:     </system>
Jul 27 09:30:21 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:21 user nova-compute[70374]:   <os>
Jul 27 09:30:21 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:21 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:21 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:21 user nova-compute[70374]:   </os>
Jul 27 09:30:21 user nova-compute[70374]:   <features>
Jul 27 09:30:21 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:21 user nova-compute[70374]:     <apic/>
Jul 27 09:30:21 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:21 user nova-compute[70374]:   </features>
Jul 27 09:30:21 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:21 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:21 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:21 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:21 user nova-compute[70374]:   </clock>
Jul 27 09:30:21 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:21 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:21 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:21 user nova-compute[70374]:   </cpu>
Jul 27 09:30:21 user nova-compute[70374]:   <devices>
Jul 27 09:30:21 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:21 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:21 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk"/>
Jul 27 09:30:21 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:21 user nova-compute[70374]:     </disk>
Jul 27 09:30:21 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:21 user nova-compute[70374]:       <mac address="fa:16:3e:ef:0f:b2"/>
Jul 27 09:30:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:21 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:21 user nova-compute[70374]:       <target dev="tapce2809b5-cc"/>
Jul 27 09:30:21 user nova-compute[70374]:     </interface>
Jul 27 09:30:21 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:21 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/console.log" append="off"/>
Jul 27 09:30:21 user nova-compute[70374]:     </serial>
Jul 27 09:30:21 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:21 user nova-compute[70374]:     <video>
Jul 27 09:30:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:21 user nova-compute[70374]:     </video>
Jul 27 09:30:21 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:21 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:21 user nova-compute[70374]:     </rng>
Jul 27 09:30:21 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:21 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:21 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:21 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:21 user nova-compute[70374]:   </devices>
Jul 27 09:30:21 user nova-compute[70374]: </domain>
Jul 27 09:30:21 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457979026',display_name='tempest-ServerRescueNegativeTestJSON-server-1457979026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457979026',id=4,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-x508h1z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:13Z,user_data=None,user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=6ae93f34-ce7e-4ae4-a5ba-36508361bd54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0f:b2,bridge_name='br-int',has_traffic_filtering=True,id=ce2809b5-cc30-4a29-9770-7df186b16406,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2809b5-cc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG os_vif [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0f:b2,bridge_name='br-int',has_traffic_filtering=True,id=ce2809b5-cc30-4a29-9770-7df186b16406,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2809b5-cc') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce2809b5-cc, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce2809b5-cc, col_values=(('external_ids', {'iface-id': 'ce2809b5-cc30-4a29-9770-7df186b16406', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:0f:b2', 'vm-uuid': '6ae93f34-ce7e-4ae4-a5ba-36508361bd54'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:21 user nova-compute[70374]: INFO os_vif [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0f:b2,bridge_name='br-int',has_traffic_filtering=True,id=ce2809b5-cc30-4a29-9770-7df186b16406,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2809b5-cc')
Jul 27 09:30:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No VIF found with MAC fa:16:3e:ef:0f:b2, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.neutron [req-eb38fdd4-8a1b-4d35-9f46-904a861b2f22 req-96424af7-e05d-4f97-bd1a-c30984cfd118 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updated VIF entry in instance network info cache for port fd47b104-c8ff-4b76-8f3a-53725f9f318c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG nova.network.neutron [req-eb38fdd4-8a1b-4d35-9f46-904a861b2f22 req-96424af7-e05d-4f97-bd1a-c30984cfd118 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eb38fdd4-8a1b-4d35-9f46-904a861b2f22 req-96424af7-e05d-4f97-bd1a-c30984cfd118 service nova] Releasing lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-8a03e8da-0ed8-4041-8b48-5fcaa38b9fea req-d51c763c-4d90-4c1b-b39b-b67516afc1e3 service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received event network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8a03e8da-0ed8-4041-8b48-5fcaa38b9fea req-d51c763c-4d90-4c1b-b39b-b67516afc1e3 service nova] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8a03e8da-0ed8-4041-8b48-5fcaa38b9fea req-d51c763c-4d90-4c1b-b39b-b67516afc1e3 service nova] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8a03e8da-0ed8-4041-8b48-5fcaa38b9fea req-d51c763c-4d90-4c1b-b39b-b67516afc1e3 service nova] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-8a03e8da-0ed8-4041-8b48-5fcaa38b9fea req-d51c763c-4d90-4c1b-b39b-b67516afc1e3 service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] No waiting events found dispatching network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:22 user nova-compute[70374]: WARNING nova.compute.manager [req-8a03e8da-0ed8-4041-8b48-5fcaa38b9fea req-d51c763c-4d90-4c1b-b39b-b67516afc1e3 service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received unexpected event network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 for instance with vm_state building and task_state spawning.
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updating instance_info_cache with network_info: [{"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Releasing lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Instance network_info: |[{"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-05c1b402-a195-437f-ba93-89117886ae9f req-67e1a680-8d9c-4dfa-80eb-4ff95b9abc8c service nova] Acquired lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.network.neutron [req-05c1b402-a195-437f-ba93-89117886ae9f req-67e1a680-8d9c-4dfa-80eb-4ff95b9abc8c service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Refreshing network info cache for port e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Start _get_guest_xml network_info=[{"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:22 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:22 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1273462667',display_name='tempest-AttachVolumeNegativeTest-server-1273462667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1273462667',id=5,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGY2O+H9PqW27GcPB7HFQV9b1fArRsb4Q62SdnMok2xNMJx4Ndfl41fCfu4LIuZgNm69n1GAW5tYyT6DlwoIS80yrefNCzUIO8hhqDUSVPM5InUIY/dZEfr1Hu+cJST4A==',key_name='tempest-keypair-1385781482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-ocp00dmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=8640c525-e6ba-4bf8-9fe0-2c08155dd1cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:44:72,bridge_name='br-int',has_traffic_filtering=True,id=e6dc311e-c8d0-4b0c-bf42-96919f9d6f02,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dc311e-c8') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'pci_devices' on Instance uuid 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:22 user nova-compute[70374]:   <uuid>8640c525-e6ba-4bf8-9fe0-2c08155dd1cb</uuid>
Jul 27 09:30:22 user nova-compute[70374]:   <name>instance-00000005</name>
Jul 27 09:30:22 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:22 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:22 user nova-compute[70374]:   <metadata>
Jul 27 09:30:22 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:22 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:22 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1273462667</nova:name>
Jul 27 09:30:22 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:22</nova:creationTime>
Jul 27 09:30:22 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:22 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:22 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:22 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:22 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:22 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:22 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:22 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:22 user nova-compute[70374]:         <nova:user uuid="4c1d49c23b0045d881d9f47e33447162">tempest-AttachVolumeNegativeTest-305502590-project-member</nova:user>
Jul 27 09:30:22 user nova-compute[70374]:         <nova:project uuid="bfaa69b3745a435795aa636ccddec3af">tempest-AttachVolumeNegativeTest-305502590</nova:project>
Jul 27 09:30:22 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:22 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:22 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:22 user nova-compute[70374]:         <nova:port uuid="e6dc311e-c8d0-4b0c-bf42-96919f9d6f02">
Jul 27 09:30:22 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 09:30:22 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:22 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:22 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:22 user nova-compute[70374]:   </metadata>
Jul 27 09:30:22 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:22 user nova-compute[70374]:     <system>
Jul 27 09:30:22 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:22 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:22 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:22 user nova-compute[70374]:       <entry name="serial">8640c525-e6ba-4bf8-9fe0-2c08155dd1cb</entry>
Jul 27 09:30:22 user nova-compute[70374]:       <entry name="uuid">8640c525-e6ba-4bf8-9fe0-2c08155dd1cb</entry>
Jul 27 09:30:22 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:22 user nova-compute[70374]:     </system>
Jul 27 09:30:22 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:22 user nova-compute[70374]:   <os>
Jul 27 09:30:22 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:22 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:22 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:22 user nova-compute[70374]:   </os>
Jul 27 09:30:22 user nova-compute[70374]:   <features>
Jul 27 09:30:22 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:22 user nova-compute[70374]:     <apic/>
Jul 27 09:30:22 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:22 user nova-compute[70374]:   </features>
Jul 27 09:30:22 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:22 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:22 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:22 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:22 user nova-compute[70374]:   </clock>
Jul 27 09:30:22 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:22 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:22 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:22 user nova-compute[70374]:   </cpu>
Jul 27 09:30:22 user nova-compute[70374]:   <devices>
Jul 27 09:30:22 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:22 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:22 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk"/>
Jul 27 09:30:22 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:22 user nova-compute[70374]:     </disk>
Jul 27 09:30:22 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:22 user nova-compute[70374]:       <mac address="fa:16:3e:21:44:72"/>
Jul 27 09:30:22 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:22 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:22 user nova-compute[70374]:       <target dev="tape6dc311e-c8"/>
Jul 27 09:30:22 user nova-compute[70374]:     </interface>
Jul 27 09:30:22 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:22 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/console.log" append="off"/>
Jul 27 09:30:22 user nova-compute[70374]:     </serial>
Jul 27 09:30:22 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:22 user nova-compute[70374]:     <video>
Jul 27 09:30:22 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:22 user nova-compute[70374]:     </video>
Jul 27 09:30:22 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:22 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:22 user nova-compute[70374]:     </rng>
Jul 27 09:30:22 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:22 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:22 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:22 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:22 user nova-compute[70374]:   </devices>
Jul 27 09:30:22 user nova-compute[70374]: </domain>
Jul 27 09:30:22 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1273462667',display_name='tempest-AttachVolumeNegativeTest-server-1273462667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1273462667',id=5,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGY2O+H9PqW27GcPB7HFQV9b1fArRsb4Q62SdnMok2xNMJx4Ndfl41fCfu4LIuZgNm69n1GAW5tYyT6DlwoIS80yrefNCzUIO8hhqDUSVPM5InUIY/dZEfr1Hu+cJST4A==',key_name='tempest-keypair-1385781482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-ocp00dmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=8640c525-e6ba-4bf8-9fe0-2c08155dd1cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:44:72,bridge_name='br-int',has_traffic_filtering=True,id=e6dc311e-c8d0-4b0c-bf42-96919f9d6f02,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dc311e-c8') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG os_vif [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:44:72,bridge_name='br-int',has_traffic_filtering=True,id=e6dc311e-c8d0-4b0c-bf42-96919f9d6f02,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dc311e-c8') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6dc311e-c8, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6dc311e-c8, col_values=(('external_ids', {'iface-id': 'e6dc311e-c8d0-4b0c-bf42-96919f9d6f02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:44:72', 'vm-uuid': '8640c525-e6ba-4bf8-9fe0-2c08155dd1cb'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:22 user nova-compute[70374]: INFO os_vif [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:44:72,bridge_name='br-int',has_traffic_filtering=True,id=e6dc311e-c8d0-4b0c-bf42-96919f9d6f02,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dc311e-c8')
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No VIF found with MAC fa:16:3e:21:44:72, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.network.neutron [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Successfully updated port: b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquired lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.network.neutron [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-348e73a8-1b23-4c8c-8555-8c3c88170049 req-1502df48-8fd1-4041-b150-726b2fda4662 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received event network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-348e73a8-1b23-4c8c-8555-8c3c88170049 req-1502df48-8fd1-4041-b150-726b2fda4662 service nova] Acquiring lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-348e73a8-1b23-4c8c-8555-8c3c88170049 req-1502df48-8fd1-4041-b150-726b2fda4662 service nova] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-348e73a8-1b23-4c8c-8555-8c3c88170049 req-1502df48-8fd1-4041-b150-726b2fda4662 service nova] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-348e73a8-1b23-4c8c-8555-8c3c88170049 req-1502df48-8fd1-4041-b150-726b2fda4662 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] No waiting events found dispatching network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:23 user nova-compute[70374]: WARNING nova.compute.manager [req-348e73a8-1b23-4c8c-8555-8c3c88170049 req-1502df48-8fd1-4041-b150-726b2fda4662 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received unexpected event network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 for instance with vm_state building and task_state spawning.
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.network.neutron [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.network.neutron [req-a765d3c0-bbef-48fa-b350-6a518a5ea414 req-28e37a0c-07b4-407a-bf17-9ba09dabc2e4 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updated VIF entry in instance network info cache for port ce2809b5-cc30-4a29-9770-7df186b16406. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.network.neutron [req-a765d3c0-bbef-48fa-b350-6a518a5ea414 req-28e37a0c-07b4-407a-bf17-9ba09dabc2e4 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updating instance_info_cache with network_info: [{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a765d3c0-bbef-48fa-b350-6a518a5ea414 req-28e37a0c-07b4-407a-bf17-9ba09dabc2e4 service nova] Releasing lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-48ad7955-1a31-46c4-9493-6247e752746e req-698b72d5-5340-42a8-b20f-d23d5ca9e1d7 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-changed-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-48ad7955-1a31-46c4-9493-6247e752746e req-698b72d5-5340-42a8-b20f-d23d5ca9e1d7 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Refreshing instance network info cache due to event network-changed-b825d9b4-15c4-4b47-a3f7-af9838d09458. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48ad7955-1a31-46c4-9493-6247e752746e req-698b72d5-5340-42a8-b20f-d23d5ca9e1d7 service nova] Acquiring lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450223.8665867, 04a990b9-ed32-41e9-b384-f0886e8d1b49 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] VM Resumed (Lifecycle Event)
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Instance spawned successfully.
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:24 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450223.8710697, 04a990b9-ed32-41e9-b384-f0886e8d1b49 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:24 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] VM Started (Lifecycle Event)
Jul 27 09:30:24 user nova-compute[70374]: INFO nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Took 16.35 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.network.neutron [req-05c1b402-a195-437f-ba93-89117886ae9f req-67e1a680-8d9c-4dfa-80eb-4ff95b9abc8c service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updated VIF entry in instance network info cache for port e6dc311e-c8d0-4b0c-bf42-96919f9d6f02. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.network.neutron [req-05c1b402-a195-437f-ba93-89117886ae9f req-67e1a680-8d9c-4dfa-80eb-4ff95b9abc8c service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updating instance_info_cache with network_info: [{"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-05c1b402-a195-437f-ba93-89117886ae9f req-67e1a680-8d9c-4dfa-80eb-4ff95b9abc8c service nova] Releasing lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:24 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:24 user nova-compute[70374]: INFO nova.compute.manager [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Took 17.25 seconds to build instance.
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-e9cedcb7-0e6d-448a-bfb6-8dcc93256d29 req-59f6d9bf-3be9-4c18-860d-cff5b53f3d64 service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received event network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9cedcb7-0e6d-448a-bfb6-8dcc93256d29 req-59f6d9bf-3be9-4c18-860d-cff5b53f3d64 service nova] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9cedcb7-0e6d-448a-bfb6-8dcc93256d29 req-59f6d9bf-3be9-4c18-860d-cff5b53f3d64 service nova] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9cedcb7-0e6d-448a-bfb6-8dcc93256d29 req-59f6d9bf-3be9-4c18-860d-cff5b53f3d64 service nova] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-e9cedcb7-0e6d-448a-bfb6-8dcc93256d29 req-59f6d9bf-3be9-4c18-860d-cff5b53f3d64 service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] No waiting events found dispatching network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:24 user nova-compute[70374]: WARNING nova.compute.manager [req-e9cedcb7-0e6d-448a-bfb6-8dcc93256d29 req-59f6d9bf-3be9-4c18-860d-cff5b53f3d64 service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received unexpected event network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 for instance with vm_state building and task_state spawning.
Jul 27 09:30:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2ec26956-f7ca-4dbf-816c-eb88f6250379 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.446s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.network.neutron [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updating instance_info_cache with network_info: [{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Releasing lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance network_info: |[{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48ad7955-1a31-46c4-9493-6247e752746e req-698b72d5-5340-42a8-b20f-d23d5ca9e1d7 service nova] Acquired lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.network.neutron [req-48ad7955-1a31-46c4-9493-6247e752746e req-698b72d5-5340-42a8-b20f-d23d5ca9e1d7 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Refreshing network info cache for port b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Start _get_guest_xml network_info=[{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:24 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:24 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.objects.instance [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'pci_devices' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:24 user nova-compute[70374]:   <uuid>25214e8a-c626-46a7-b273-eb491c2fc91b</uuid>
Jul 27 09:30:24 user nova-compute[70374]:   <name>instance-00000006</name>
Jul 27 09:30:24 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:24 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:24 user nova-compute[70374]:   <metadata>
Jul 27 09:30:24 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:24 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:24 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeTestJSON-server-1408375692</nova:name>
Jul 27 09:30:24 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:24</nova:creationTime>
Jul 27 09:30:24 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:24 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:24 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:24 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:24 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:24 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:24 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:24 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:24 user nova-compute[70374]:         <nova:user uuid="9d4c5ec795ee4d3387ce8718d2ac67e0">tempest-AttachVolumeTestJSON-847846253-project-member</nova:user>
Jul 27 09:30:24 user nova-compute[70374]:         <nova:project uuid="0592f0be670742a181e24823955f378b">tempest-AttachVolumeTestJSON-847846253</nova:project>
Jul 27 09:30:24 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:24 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:24 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:24 user nova-compute[70374]:         <nova:port uuid="b825d9b4-15c4-4b47-a3f7-af9838d09458">
Jul 27 09:30:24 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 09:30:24 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:24 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:24 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:24 user nova-compute[70374]:   </metadata>
Jul 27 09:30:24 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:24 user nova-compute[70374]:     <system>
Jul 27 09:30:24 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:24 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:24 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:24 user nova-compute[70374]:       <entry name="serial">25214e8a-c626-46a7-b273-eb491c2fc91b</entry>
Jul 27 09:30:24 user nova-compute[70374]:       <entry name="uuid">25214e8a-c626-46a7-b273-eb491c2fc91b</entry>
Jul 27 09:30:24 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:24 user nova-compute[70374]:     </system>
Jul 27 09:30:24 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:24 user nova-compute[70374]:   <os>
Jul 27 09:30:24 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:24 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:24 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:24 user nova-compute[70374]:   </os>
Jul 27 09:30:24 user nova-compute[70374]:   <features>
Jul 27 09:30:24 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:24 user nova-compute[70374]:     <apic/>
Jul 27 09:30:24 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:24 user nova-compute[70374]:   </features>
Jul 27 09:30:24 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:24 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:24 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:24 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:24 user nova-compute[70374]:   </clock>
Jul 27 09:30:24 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:24 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:24 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:24 user nova-compute[70374]:   </cpu>
Jul 27 09:30:24 user nova-compute[70374]:   <devices>
Jul 27 09:30:24 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:24 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:24 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk"/>
Jul 27 09:30:24 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:24 user nova-compute[70374]:     </disk>
Jul 27 09:30:24 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:24 user nova-compute[70374]:       <mac address="fa:16:3e:b2:af:a6"/>
Jul 27 09:30:24 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:24 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:24 user nova-compute[70374]:       <target dev="tapb825d9b4-15"/>
Jul 27 09:30:24 user nova-compute[70374]:     </interface>
Jul 27 09:30:24 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:24 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/console.log" append="off"/>
Jul 27 09:30:24 user nova-compute[70374]:     </serial>
Jul 27 09:30:24 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:24 user nova-compute[70374]:     <video>
Jul 27 09:30:24 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:24 user nova-compute[70374]:     </video>
Jul 27 09:30:24 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:24 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:24 user nova-compute[70374]:     </rng>
Jul 27 09:30:24 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:24 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:24 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:24 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:24 user nova-compute[70374]:   </devices>
Jul 27 09:30:24 user nova-compute[70374]: </domain>
Jul 27 09:30:24 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG os_vif [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb825d9b4-15, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb825d9b4-15, col_values=(('external_ids', {'iface-id': 'b825d9b4-15c4-4b47-a3f7-af9838d09458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:af:a6', 'vm-uuid': '25214e8a-c626-46a7-b273-eb491c2fc91b'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:24 user nova-compute[70374]: INFO os_vif [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15')
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No VIF found with MAC fa:16:3e:b2:af:a6, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:25 user nova-compute[70374]: WARNING nova.compute.manager [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state building and task_state spawning.
Jul 27 09:30:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:25 user nova-compute[70374]: WARNING nova.compute.manager [req-fe2e302b-3b25-4fb7-972e-10364157a376 req-87f6761a-ddfc-49da-81f6-5591c7c5a56b service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state building and task_state spawning.
Jul 27 09:30:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-48ad7955-1a31-46c4-9493-6247e752746e req-698b72d5-5340-42a8-b20f-d23d5ca9e1d7 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updated VIF entry in instance network info cache for port b825d9b4-15c4-4b47-a3f7-af9838d09458. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-48ad7955-1a31-46c4-9493-6247e752746e req-698b72d5-5340-42a8-b20f-d23d5ca9e1d7 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updating instance_info_cache with network_info: [{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48ad7955-1a31-46c4-9493-6247e752746e req-698b72d5-5340-42a8-b20f-d23d5ca9e1d7 service nova] Releasing lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450226.6344206, 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:26 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] VM Resumed (Lifecycle Event)
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Instance spawned successfully.
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:26 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450226.6563246, 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:26 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] VM Started (Lifecycle Event)
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:26 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:26 user nova-compute[70374]: INFO nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Took 13.93 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:27 user nova-compute[70374]: INFO nova.compute.manager [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Took 14.76 seconds to build instance.
Jul 27 09:30:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-fec1f2d0-8fc5-46cd-8d73-ac60877a0c48 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.906s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:27 user nova-compute[70374]: WARNING nova.compute.manager [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state building and task_state spawning.
Jul 27 09:30:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:27 user nova-compute[70374]: WARNING nova.compute.manager [req-d0bc7ef6-0c05-4897-a7ee-975c06eda5d7 req-6182069e-042d-47de-a45e-24dfdb463306 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state building and task_state spawning.
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450228.4746044, fb5ccac9-1e45-4726-b681-cf34cf3fa521 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:28 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] VM Resumed (Lifecycle Event)
Jul 27 09:30:28 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance spawned successfully.
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:28 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450228.4747803, fb5ccac9-1e45-4726-b681-cf34cf3fa521 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:28 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] VM Started (Lifecycle Event)
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:28 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:28 user nova-compute[70374]: INFO nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Took 17.81 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:28 user nova-compute[70374]: INFO nova.compute.manager [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Took 19.06 seconds to build instance.
Jul 27 09:30:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cdfda19c-0d10-40e6-9a38-7ff6ede4bafb tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.240s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-d3dd70fc-ddb8-4a8b-ba5a-960a5b022eba req-122bd9a1-655b-4670-b76f-4b58a916c592 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d3dd70fc-ddb8-4a8b-ba5a-960a5b022eba req-122bd9a1-655b-4670-b76f-4b58a916c592 service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d3dd70fc-ddb8-4a8b-ba5a-960a5b022eba req-122bd9a1-655b-4670-b76f-4b58a916c592 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d3dd70fc-ddb8-4a8b-ba5a-960a5b022eba req-122bd9a1-655b-4670-b76f-4b58a916c592 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-d3dd70fc-ddb8-4a8b-ba5a-960a5b022eba req-122bd9a1-655b-4670-b76f-4b58a916c592 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:29 user nova-compute[70374]: WARNING nova.compute.manager [req-d3dd70fc-ddb8-4a8b-ba5a-960a5b022eba req-122bd9a1-655b-4670-b76f-4b58a916c592 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state building and task_state spawning.
Jul 27 09:30:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-1ebabe94-93e6-4b27-b197-7242c91fa071 req-b560cb76-90fe-41dd-bc3a-e5b961f27634 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1ebabe94-93e6-4b27-b197-7242c91fa071 req-b560cb76-90fe-41dd-bc3a-e5b961f27634 service nova] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1ebabe94-93e6-4b27-b197-7242c91fa071 req-b560cb76-90fe-41dd-bc3a-e5b961f27634 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1ebabe94-93e6-4b27-b197-7242c91fa071 req-b560cb76-90fe-41dd-bc3a-e5b961f27634 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-1ebabe94-93e6-4b27-b197-7242c91fa071 req-b560cb76-90fe-41dd-bc3a-e5b961f27634 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] No waiting events found dispatching network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:29 user nova-compute[70374]: WARNING nova.compute.manager [req-1ebabe94-93e6-4b27-b197-7242c91fa071 req-b560cb76-90fe-41dd-bc3a-e5b961f27634 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received unexpected event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 for instance with vm_state building and task_state spawning.
Jul 27 09:30:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450230.080256, 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:30 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] VM Resumed (Lifecycle Event)
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:30 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Instance spawned successfully.
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:30 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450230.0804617, 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:30 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] VM Started (Lifecycle Event)
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:30 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:30 user nova-compute[70374]: INFO nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Took 16.88 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:30 user nova-compute[70374]: INFO nova.compute.manager [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Took 18.14 seconds to build instance.
Jul 27 09:30:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5a50d6dc-fbe1-45e4-a8f9-8c00e88048a3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.295s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-46cc828c-a689-4ba5-9c73-56031dda7f05 req-3b81f859-cbe6-4b03-899e-773dcce7aae5 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-46cc828c-a689-4ba5-9c73-56031dda7f05 req-3b81f859-cbe6-4b03-899e-773dcce7aae5 service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-46cc828c-a689-4ba5-9c73-56031dda7f05 req-3b81f859-cbe6-4b03-899e-773dcce7aae5 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-46cc828c-a689-4ba5-9c73-56031dda7f05 req-3b81f859-cbe6-4b03-899e-773dcce7aae5 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-46cc828c-a689-4ba5-9c73-56031dda7f05 req-3b81f859-cbe6-4b03-899e-773dcce7aae5 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:31 user nova-compute[70374]: WARNING nova.compute.manager [req-46cc828c-a689-4ba5-9c73-56031dda7f05 req-3b81f859-cbe6-4b03-899e-773dcce7aae5 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state building and task_state spawning.
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450231.3793561, 25214e8a-c626-46a7-b273-eb491c2fc91b => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Resumed (Lifecycle Event)
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance spawned successfully.
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450231.381748, 25214e8a-c626-46a7-b273-eb491c2fc91b => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Started (Lifecycle Event)
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Instance spawned successfully.
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-f29206a5-a4fd-434d-a971-fec17fbd62d9 req-d4627134-b222-4574-ad70-3e3d20080aee service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f29206a5-a4fd-434d-a971-fec17fbd62d9 req-d4627134-b222-4574-ad70-3e3d20080aee service nova] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f29206a5-a4fd-434d-a971-fec17fbd62d9 req-d4627134-b222-4574-ad70-3e3d20080aee service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f29206a5-a4fd-434d-a971-fec17fbd62d9 req-d4627134-b222-4574-ad70-3e3d20080aee service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-f29206a5-a4fd-434d-a971-fec17fbd62d9 req-d4627134-b222-4574-ad70-3e3d20080aee service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] No waiting events found dispatching network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:31 user nova-compute[70374]: WARNING nova.compute.manager [req-f29206a5-a4fd-434d-a971-fec17fbd62d9 req-d4627134-b222-4574-ad70-3e3d20080aee service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received unexpected event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 for instance with vm_state building and task_state spawning.
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450231.5341854, 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] VM Resumed (Lifecycle Event)
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Took 14.52 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:31 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450231.5343678, 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] VM Started (Lifecycle Event)
Jul 27 09:30:32 user nova-compute[70374]: INFO nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Took 15.97 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:32 user nova-compute[70374]: INFO nova.compute.manager [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Took 16.90 seconds to build instance.
Jul 27 09:30:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7a680851-07bd-4ef5-bc9b-c2b59b67dca7 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.094s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:32 user nova-compute[70374]: INFO nova.compute.manager [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Took 15.69 seconds to build instance.
Jul 27 09:30:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-571092ad-27a5-4e72-b88c-d36bcbadaa88 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.850s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:38 user nova-compute[70374]: INFO nova.compute.claims [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Claim successful on node user
Jul 27 09:30:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:39 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:39 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.780s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:39 user nova-compute[70374]: DEBUG nova.network.neutron [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:39 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:40 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Creating image(s)
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "/opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "/opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "/opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG nova.policy [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9eecf77414d9472e9e3cd10aec673afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3b4d25fdc94c4ea2e148e16478b40c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.331s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.225s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk 1073741824" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.379s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.249s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Cannot resize image /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG nova.objects.instance [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'migration_context' on Instance uuid 42f4c546-47e4-485b-be29-4081c7557bad {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Ensure instance console log exists: /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Successfully created port: cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:45 user nova-compute[70374]: INFO nova.compute.claims [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Claim successful on node user
Jul 27 09:30:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Successfully updated port: cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquired lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-507c555b-d164-4237-8a47-3c15957e423c req-bc88dd74-b059-4699-afb5-1997246f8556 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received event network-changed-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-507c555b-d164-4237-8a47-3c15957e423c req-bc88dd74-b059-4699-afb5-1997246f8556 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Refreshing instance network info cache due to event network-changed-cc9444e6-2840-433c-b7c9-c0df023f6e43. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-507c555b-d164-4237-8a47-3c15957e423c req-bc88dd74-b059-4699-afb5-1997246f8556 service nova] Acquiring lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.955s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:46 user nova-compute[70374]: INFO nova.compute.claims [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Claim successful on node user
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "773917c6-56d7-4491-a760-05f51593b7f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updating instance_info_cache with network_info: [{"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Releasing lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Instance network_info: |[{"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-507c555b-d164-4237-8a47-3c15957e423c req-bc88dd74-b059-4699-afb5-1997246f8556 service nova] Acquired lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.network.neutron [req-507c555b-d164-4237-8a47-3c15957e423c req-bc88dd74-b059-4699-afb5-1997246f8556 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Refreshing network info cache for port cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Start _get_guest_xml network_info=[{"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:46 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:46 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:46 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1688768109',display_name='tempest-VolumesAdminNegativeTest-server-1688768109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1688768109',id=7,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB50mdHMzOWpotVJV8Hy2B+a9kMnUfx8ncrgXuU5l2s3b2+0s8/IzVYVCK3PIMbOCNWJ+oVutS4E8rj/IvnO7glUGqYpvl5OiKzQBseAPNzkTYHLXKqMWqY/freXFLIXKA==',key_name='tempest-keypair-110342931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa3b4d25fdc94c4ea2e148e16478b40c',ramdisk_id='',reservation_id='r-xt39zy6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1398001736',owner_user_name='tempest-VolumesAdminNegativeTest-1398001736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eecf77414d9472e9e3cd10aec673afb',uuid=42f4c546-47e4-485b-be29-4081c7557bad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converting VIF {"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c6:71,bridge_name='br-int',has_traffic_filtering=True,id=cc9444e6-2840-433c-b7c9-c0df023f6e43,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9444e6-28') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'pci_devices' on Instance uuid 42f4c546-47e4-485b-be29-4081c7557bad {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.policy [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '103aa251c26c4987814bc5973d86e601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd638e5400740279443a374e3e570d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:46 user nova-compute[70374]:   <uuid>42f4c546-47e4-485b-be29-4081c7557bad</uuid>
Jul 27 09:30:46 user nova-compute[70374]:   <name>instance-00000007</name>
Jul 27 09:30:46 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:46 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:46 user nova-compute[70374]:   <metadata>
Jul 27 09:30:46 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:46 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:46 user nova-compute[70374]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1688768109</nova:name>
Jul 27 09:30:46 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:46</nova:creationTime>
Jul 27 09:30:46 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:46 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:46 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:46 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:46 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:46 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:46 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:46 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:46 user nova-compute[70374]:         <nova:user uuid="9eecf77414d9472e9e3cd10aec673afb">tempest-VolumesAdminNegativeTest-1398001736-project-member</nova:user>
Jul 27 09:30:46 user nova-compute[70374]:         <nova:project uuid="aa3b4d25fdc94c4ea2e148e16478b40c">tempest-VolumesAdminNegativeTest-1398001736</nova:project>
Jul 27 09:30:46 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:46 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:46 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:46 user nova-compute[70374]:         <nova:port uuid="cc9444e6-2840-433c-b7c9-c0df023f6e43">
Jul 27 09:30:46 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 09:30:46 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:46 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:46 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:46 user nova-compute[70374]:   </metadata>
Jul 27 09:30:46 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:46 user nova-compute[70374]:     <system>
Jul 27 09:30:46 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:46 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:46 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:46 user nova-compute[70374]:       <entry name="serial">42f4c546-47e4-485b-be29-4081c7557bad</entry>
Jul 27 09:30:46 user nova-compute[70374]:       <entry name="uuid">42f4c546-47e4-485b-be29-4081c7557bad</entry>
Jul 27 09:30:46 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:46 user nova-compute[70374]:     </system>
Jul 27 09:30:46 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:46 user nova-compute[70374]:   <os>
Jul 27 09:30:46 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:46 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:46 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:46 user nova-compute[70374]:   </os>
Jul 27 09:30:46 user nova-compute[70374]:   <features>
Jul 27 09:30:46 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:46 user nova-compute[70374]:     <apic/>
Jul 27 09:30:46 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:46 user nova-compute[70374]:   </features>
Jul 27 09:30:46 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:46 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:46 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:46 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:46 user nova-compute[70374]:   </clock>
Jul 27 09:30:46 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:46 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:46 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:46 user nova-compute[70374]:   </cpu>
Jul 27 09:30:46 user nova-compute[70374]:   <devices>
Jul 27 09:30:46 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:46 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:46 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk"/>
Jul 27 09:30:46 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:46 user nova-compute[70374]:     </disk>
Jul 27 09:30:46 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:46 user nova-compute[70374]:       <mac address="fa:16:3e:bf:c6:71"/>
Jul 27 09:30:46 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:46 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:46 user nova-compute[70374]:       <target dev="tapcc9444e6-28"/>
Jul 27 09:30:46 user nova-compute[70374]:     </interface>
Jul 27 09:30:46 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:46 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/console.log" append="off"/>
Jul 27 09:30:46 user nova-compute[70374]:     </serial>
Jul 27 09:30:46 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:46 user nova-compute[70374]:     <video>
Jul 27 09:30:46 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:46 user nova-compute[70374]:     </video>
Jul 27 09:30:46 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:46 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:46 user nova-compute[70374]:     </rng>
Jul 27 09:30:46 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:46 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:46 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:46 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:46 user nova-compute[70374]:   </devices>
Jul 27 09:30:46 user nova-compute[70374]: </domain>
Jul 27 09:30:46 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1688768109',display_name='tempest-VolumesAdminNegativeTest-server-1688768109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1688768109',id=7,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB50mdHMzOWpotVJV8Hy2B+a9kMnUfx8ncrgXuU5l2s3b2+0s8/IzVYVCK3PIMbOCNWJ+oVutS4E8rj/IvnO7glUGqYpvl5OiKzQBseAPNzkTYHLXKqMWqY/freXFLIXKA==',key_name='tempest-keypair-110342931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa3b4d25fdc94c4ea2e148e16478b40c',ramdisk_id='',reservation_id='r-xt39zy6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1398001736',owner_user_name='tempest-VolumesAdminNegativeTest-1398001736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eecf77414d9472e9e3cd10aec673afb',uuid=42f4c546-47e4-485b-be29-4081c7557bad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converting VIF {"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c6:71,bridge_name='br-int',has_traffic_filtering=True,id=cc9444e6-2840-433c-b7c9-c0df023f6e43,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9444e6-28') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG os_vif [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c6:71,bridge_name='br-int',has_traffic_filtering=True,id=cc9444e6-2840-433c-b7c9-c0df023f6e43,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9444e6-28') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc9444e6-28, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc9444e6-28, col_values=(('external_ids', {'iface-id': 'cc9444e6-2840-433c-b7c9-c0df023f6e43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:c6:71', 'vm-uuid': '42f4c546-47e4-485b-be29-4081c7557bad'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:47 user nova-compute[70374]: INFO os_vif [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c6:71,bridge_name='br-int',has_traffic_filtering=True,id=cc9444e6-2840-433c-b7c9-c0df023f6e43,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9444e6-28')
Jul 27 09:30:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:47 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Creating image(s)
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "/opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "/opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "/opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "f45ce42723178ed0c3f545cbb0d68bcf7bb43056" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "f45ce42723178ed0c3f545cbb0d68bcf7bb43056" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] No VIF found with MAC fa:16:3e:bf:c6:71, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056.part --force-share --output=json" returned: 0 in 0.197s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG nova.virt.images [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] 726e1210-3ce3-486f-9417-95adaf9ac235 was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056.part /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056.part /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056.converted" returned: 0 in 0.230s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.794s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.298s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:48 user nova-compute[70374]: INFO nova.compute.claims [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Claim successful on node user
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "f45ce42723178ed0c3f545cbb0d68bcf7bb43056" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.127s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.network.neutron [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.network.neutron [req-507c555b-d164-4237-8a47-3c15957e423c req-bc88dd74-b059-4699-afb5-1997246f8556 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updated VIF entry in instance network info cache for port cc9444e6-2840-433c-b7c9-c0df023f6e43. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.network.neutron [req-507c555b-d164-4237-8a47-3c15957e423c req-bc88dd74-b059-4699-afb5-1997246f8556 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updating instance_info_cache with network_info: [{"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-507c555b-d164-4237-8a47-3c15957e423c req-bc88dd74-b059-4699-afb5-1997246f8556 service nova] Releasing lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.network.neutron [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Successfully created port: 626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056 --force-share --output=json" returned: 0 in 0.214s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.policy [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9597f10b87aa426b812375b1770d3095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2010f7a57b654bee8736f3ed8d805b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "f45ce42723178ed0c3f545cbb0d68bcf7bb43056" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "f45ce42723178ed0c3f545cbb0d68bcf7bb43056" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Creating image(s)
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "/opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "/opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "/opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056 --force-share --output=json" returned: 0 in 0.242s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056,backing_fmt=raw /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.178s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056,backing_fmt=raw /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk 1073741824" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "f45ce42723178ed0c3f545cbb0d68bcf7bb43056" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.400s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.217s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056 --force-share --output=json" returned: 0 in 0.265s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Checking if we can resize image /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk 1073741824" returned: 0 in 0.181s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-d676d539-77b2-4780-9efa-2aca9ff24935 req-972b4e2f-141c-425e-bb0b-e7c9ff9cdf13 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received event network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d676d539-77b2-4780-9efa-2aca9ff24935 req-972b4e2f-141c-425e-bb0b-e7c9ff9cdf13 service nova] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d676d539-77b2-4780-9efa-2aca9ff24935 req-972b4e2f-141c-425e-bb0b-e7c9ff9cdf13 service nova] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d676d539-77b2-4780-9efa-2aca9ff24935 req-972b4e2f-141c-425e-bb0b-e7c9ff9cdf13 service nova] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-d676d539-77b2-4780-9efa-2aca9ff24935 req-972b4e2f-141c-425e-bb0b-e7c9ff9cdf13 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] No waiting events found dispatching network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:49 user nova-compute[70374]: WARNING nova.compute.manager [req-d676d539-77b2-4780-9efa-2aca9ff24935 req-972b4e2f-141c-425e-bb0b-e7c9ff9cdf13 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received unexpected event network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 for instance with vm_state building and task_state spawning.
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Cannot resize image /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lazy-loading 'migration_context' on Instance uuid 309c9c26-4a0f-45db-bb3a-595b19f3f627 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Ensure instance console log exists: /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.199s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.276s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Successfully created port: 018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Cannot resize image /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lazy-loading 'migration_context' on Instance uuid d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Ensure instance console log exists: /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Creating image(s)
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "/opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "/opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "/opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG nova.policy [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '459cb24159604669a118a1da67fbdf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88292245b8d4bbfa07efc8084ae089c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.169s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.175s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk 1073741824" returned: 0 in 0.075s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.170s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Checking if we can resize image /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Cannot resize image /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.objects.instance [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lazy-loading 'migration_context' on Instance uuid 773917c6-56d7-4491-a760-05f51593b7f0 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Ensure instance console log exists: /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Successfully updated port: 018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquired lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-91ea84f1-9609-4208-bfec-0b0d8dc62bc8 req-dbe3b311-80ba-4872-aa04-8c38e6b58ce8 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received event network-changed-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-91ea84f1-9609-4208-bfec-0b0d8dc62bc8 req-dbe3b311-80ba-4872-aa04-8c38e6b58ce8 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Refreshing instance network info cache due to event network-changed-018c2bfb-405c-4bba-a54f-e8ea773e57bf. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-91ea84f1-9609-4208-bfec-0b0d8dc62bc8 req-dbe3b311-80ba-4872-aa04-8c38e6b58ce8 service nova] Acquiring lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Successfully updated port: 626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquired lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450251.278169, 42f4c546-47e4-485b-be29-4081c7557bad => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] VM Resumed (Lifecycle Event)
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Instance spawned successfully.
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Updating instance_info_cache with network_info: [{"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Releasing lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Instance network_info: |[{"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-91ea84f1-9609-4208-bfec-0b0d8dc62bc8 req-dbe3b311-80ba-4872-aa04-8c38e6b58ce8 service nova] Acquired lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-91ea84f1-9609-4208-bfec-0b0d8dc62bc8 req-dbe3b311-80ba-4872-aa04-8c38e6b58ce8 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Refreshing network info cache for port 018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Start _get_guest_xml network_info=[{"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450251.278965, 42f4c546-47e4-485b-be29-4081c7557bad => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] VM Started (Lifecycle Event)
Jul 27 09:30:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1780453082',display_name='tempest-TestVolumeSwap-server-1780453082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1780453082',id=9,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaNbtFtor1bqTgF+b2crgVHLS9gnhKdKp9dMQdiKNpBIvJQwJpmePSBuDiTyWesfiLJRcs+yKbdVF9O+syPsBVqVGKrGBXSpMVjRmnYBFtocxj+nET2lsNkoXtTK+YyzQ==',key_name='tempest-keypair-612516559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2010f7a57b654bee8736f3ed8d805b2c',ramdisk_id='',reservation_id='r-d2e70j2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-987419093',owner_user_name='tempest-TestVolumeSwap-987419093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9597f10b87aa426b812375b1770d3095',uuid=d35fe056-8279-479a-a673-6c61e5ec6933,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Converting VIF {"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:78,bridge_name='br-int',has_traffic_filtering=True,id=018c2bfb-405c-4bba-a54f-e8ea773e57bf,network=Network(aead18f5-45fa-4ce5-9c4a-086f9f9d07e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018c2bfb-40') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lazy-loading 'pci_devices' on Instance uuid d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received event network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] No waiting events found dispatching network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:51 user nova-compute[70374]: WARNING nova.compute.manager [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received unexpected event network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 for instance with vm_state building and task_state spawning.
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received event network-changed-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Refreshing instance network info cache due to event network-changed-626b287e-22ee-49d7-8ec3-c1a0660bd5d8. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] Acquiring lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Successfully created port: c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:51 user nova-compute[70374]:   <uuid>d35fe056-8279-479a-a673-6c61e5ec6933</uuid>
Jul 27 09:30:51 user nova-compute[70374]:   <name>instance-00000009</name>
Jul 27 09:30:51 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:51 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:51 user nova-compute[70374]:   <metadata>
Jul 27 09:30:51 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:51 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:51 user nova-compute[70374]:       <nova:name>tempest-TestVolumeSwap-server-1780453082</nova:name>
Jul 27 09:30:51 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:51</nova:creationTime>
Jul 27 09:30:51 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:51 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:51 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:51 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:51 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:51 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:51 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:51 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:51 user nova-compute[70374]:         <nova:user uuid="9597f10b87aa426b812375b1770d3095">tempest-TestVolumeSwap-987419093-project-member</nova:user>
Jul 27 09:30:51 user nova-compute[70374]:         <nova:project uuid="2010f7a57b654bee8736f3ed8d805b2c">tempest-TestVolumeSwap-987419093</nova:project>
Jul 27 09:30:51 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:51 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:51 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:51 user nova-compute[70374]:         <nova:port uuid="018c2bfb-405c-4bba-a54f-e8ea773e57bf">
Jul 27 09:30:51 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 09:30:51 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:51 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:51 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:51 user nova-compute[70374]:   </metadata>
Jul 27 09:30:51 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:51 user nova-compute[70374]:     <system>
Jul 27 09:30:51 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:51 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:51 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:51 user nova-compute[70374]:       <entry name="serial">d35fe056-8279-479a-a673-6c61e5ec6933</entry>
Jul 27 09:30:51 user nova-compute[70374]:       <entry name="uuid">d35fe056-8279-479a-a673-6c61e5ec6933</entry>
Jul 27 09:30:51 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:51 user nova-compute[70374]:     </system>
Jul 27 09:30:51 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:51 user nova-compute[70374]:   <os>
Jul 27 09:30:51 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:51 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:51 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:51 user nova-compute[70374]:   </os>
Jul 27 09:30:51 user nova-compute[70374]:   <features>
Jul 27 09:30:51 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:51 user nova-compute[70374]:     <apic/>
Jul 27 09:30:51 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:51 user nova-compute[70374]:   </features>
Jul 27 09:30:51 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:51 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:51 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:51 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:51 user nova-compute[70374]:   </clock>
Jul 27 09:30:51 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:51 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:51 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:51 user nova-compute[70374]:   </cpu>
Jul 27 09:30:51 user nova-compute[70374]:   <devices>
Jul 27 09:30:51 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:51 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:51 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk"/>
Jul 27 09:30:51 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:51 user nova-compute[70374]:     </disk>
Jul 27 09:30:51 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:51 user nova-compute[70374]:       <mac address="fa:16:3e:2d:07:78"/>
Jul 27 09:30:51 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:51 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:51 user nova-compute[70374]:       <target dev="tap018c2bfb-40"/>
Jul 27 09:30:51 user nova-compute[70374]:     </interface>
Jul 27 09:30:51 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:51 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/console.log" append="off"/>
Jul 27 09:30:51 user nova-compute[70374]:     </serial>
Jul 27 09:30:51 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:51 user nova-compute[70374]:     <video>
Jul 27 09:30:51 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:51 user nova-compute[70374]:     </video>
Jul 27 09:30:51 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:51 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:51 user nova-compute[70374]:     </rng>
Jul 27 09:30:51 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:51 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:51 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:51 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:51 user nova-compute[70374]:   </devices>
Jul 27 09:30:51 user nova-compute[70374]: </domain>
Jul 27 09:30:51 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1780453082',display_name='tempest-TestVolumeSwap-server-1780453082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1780453082',id=9,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaNbtFtor1bqTgF+b2crgVHLS9gnhKdKp9dMQdiKNpBIvJQwJpmePSBuDiTyWesfiLJRcs+yKbdVF9O+syPsBVqVGKrGBXSpMVjRmnYBFtocxj+nET2lsNkoXtTK+YyzQ==',key_name='tempest-keypair-612516559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2010f7a57b654bee8736f3ed8d805b2c',ramdisk_id='',reservation_id='r-d2e70j2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-987419093',owner_user_name='tempest-TestVolumeSwap-987419093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9597f10b87aa426b812375b1770d3095',uuid=d35fe056-8279-479a-a673-6c61e5ec6933,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Converting VIF {"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:78,bridge_name='br-int',has_traffic_filtering=True,id=018c2bfb-405c-4bba-a54f-e8ea773e57bf,network=Network(aead18f5-45fa-4ce5-9c4a-086f9f9d07e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018c2bfb-40') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG os_vif [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:78,bridge_name='br-int',has_traffic_filtering=True,id=018c2bfb-405c-4bba-a54f-e8ea773e57bf,network=Network(aead18f5-45fa-4ce5-9c4a-086f9f9d07e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018c2bfb-40') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap018c2bfb-40, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap018c2bfb-40, col_values=(('external_ids', {'iface-id': '018c2bfb-405c-4bba-a54f-e8ea773e57bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:07:78', 'vm-uuid': 'd35fe056-8279-479a-a673-6c61e5ec6933'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:51 user nova-compute[70374]: INFO nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Took 11.31 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:51 user nova-compute[70374]: INFO os_vif [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:78,bridge_name='br-int',has_traffic_filtering=True,id=018c2bfb-405c-4bba-a54f-e8ea773e57bf,network=Network(aead18f5-45fa-4ce5-9c4a-086f9f9d07e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018c2bfb-40')
Jul 27 09:30:51 user nova-compute[70374]: INFO nova.compute.manager [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Took 12.75 seconds to build instance.
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] No VIF found with MAC fa:16:3e:2d:07:78, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-42453f95-88b3-4b3c-82a7-e81b0135f19c tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.907s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-91ea84f1-9609-4208-bfec-0b0d8dc62bc8 req-dbe3b311-80ba-4872-aa04-8c38e6b58ce8 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Updated VIF entry in instance network info cache for port 018c2bfb-405c-4bba-a54f-e8ea773e57bf. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-91ea84f1-9609-4208-bfec-0b0d8dc62bc8 req-dbe3b311-80ba-4872-aa04-8c38e6b58ce8 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Updating instance_info_cache with network_info: [{"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-91ea84f1-9609-4208-bfec-0b0d8dc62bc8 req-dbe3b311-80ba-4872-aa04-8c38e6b58ce8 service nova] Releasing lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Updating instance_info_cache with network_info: [{"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Releasing lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Instance network_info: |[{"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] Acquired lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Refreshing network info cache for port 626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Start _get_guest_xml network_info=[{"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:30:30Z,direct_url=<?>,disk_format='qcow2',id=726e1210-3ce3-486f-9417-95adaf9ac235,min_disk=0,min_ram=0,name='',owner='f6e8c1f6841a4a30857193d07747038e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:30:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'image_id': '726e1210-3ce3-486f-9417-95adaf9ac235'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:30:30Z,direct_url=<?>,disk_format='qcow2',id=726e1210-3ce3-486f-9417-95adaf9ac235,min_disk=0,min_ram=0,name='',owner='f6e8c1f6841a4a30857193d07747038e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:30:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-860974169',display_name='tempest-AttachSCSIVolumeTestJSON-server-860974169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-860974169',id=8,image_ref='726e1210-3ce3-486f-9417-95adaf9ac235',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2UxiY9xja9j2e+bYNFRInNFJS7DjB/7i9A7rll9a0HowWQT/92Qp4K1SO60+YclaZAVgDJD7MloBXQCsn+BhUVizXOve/ao95EzmtZUBSUTgLTVXF8O7s8qW7tjuxGXQ==',key_name='tempest-keypair-936823846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd638e5400740279443a374e3e570d4',ramdisk_id='',reservation_id='r-010r1p2b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='726e1210-3ce3-486f-9417-95adaf9ac235',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-284147988',owner_user_name='tempest-AttachSCSIVolumeTestJSON-284147988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='103aa251c26c4987814bc5973d86e601',uuid=309c9c26-4a0f-45db-bb3a-595b19f3f627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Converting VIF {"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:6c:c6,bridge_name='br-int',has_traffic_filtering=True,id=626b287e-22ee-49d7-8ec3-c1a0660bd5d8,network=Network(f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626b287e-22') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lazy-loading 'pci_devices' on Instance uuid 309c9c26-4a0f-45db-bb3a-595b19f3f627 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:52 user nova-compute[70374]:   <uuid>309c9c26-4a0f-45db-bb3a-595b19f3f627</uuid>
Jul 27 09:30:52 user nova-compute[70374]:   <name>instance-00000008</name>
Jul 27 09:30:52 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:52 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:52 user nova-compute[70374]:   <metadata>
Jul 27 09:30:52 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:52 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:52 user nova-compute[70374]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-860974169</nova:name>
Jul 27 09:30:52 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:52</nova:creationTime>
Jul 27 09:30:52 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:52 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:52 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:52 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:52 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:52 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:52 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:52 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:52 user nova-compute[70374]:         <nova:user uuid="103aa251c26c4987814bc5973d86e601">tempest-AttachSCSIVolumeTestJSON-284147988-project-member</nova:user>
Jul 27 09:30:52 user nova-compute[70374]:         <nova:project uuid="cdd638e5400740279443a374e3e570d4">tempest-AttachSCSIVolumeTestJSON-284147988</nova:project>
Jul 27 09:30:52 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:52 user nova-compute[70374]:       <nova:root type="image" uuid="726e1210-3ce3-486f-9417-95adaf9ac235"/>
Jul 27 09:30:52 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:52 user nova-compute[70374]:         <nova:port uuid="626b287e-22ee-49d7-8ec3-c1a0660bd5d8">
Jul 27 09:30:52 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 09:30:52 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:52 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:52 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:52 user nova-compute[70374]:   </metadata>
Jul 27 09:30:52 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:52 user nova-compute[70374]:     <system>
Jul 27 09:30:52 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:52 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:52 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:52 user nova-compute[70374]:       <entry name="serial">309c9c26-4a0f-45db-bb3a-595b19f3f627</entry>
Jul 27 09:30:52 user nova-compute[70374]:       <entry name="uuid">309c9c26-4a0f-45db-bb3a-595b19f3f627</entry>
Jul 27 09:30:52 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:52 user nova-compute[70374]:     </system>
Jul 27 09:30:52 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:52 user nova-compute[70374]:   <os>
Jul 27 09:30:52 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:52 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:52 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:52 user nova-compute[70374]:   </os>
Jul 27 09:30:52 user nova-compute[70374]:   <features>
Jul 27 09:30:52 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:52 user nova-compute[70374]:     <apic/>
Jul 27 09:30:52 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:52 user nova-compute[70374]:   </features>
Jul 27 09:30:52 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:52 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:52 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:52 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:52 user nova-compute[70374]:   </clock>
Jul 27 09:30:52 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:52 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:52 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:52 user nova-compute[70374]:   </cpu>
Jul 27 09:30:52 user nova-compute[70374]:   <devices>
Jul 27 09:30:52 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:52 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:52 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk"/>
Jul 27 09:30:52 user nova-compute[70374]:       <target dev="sda" bus="scsi"/>
Jul 27 09:30:52 user nova-compute[70374]:       <address type="drive" controller="0" unit="0"/>
Jul 27 09:30:52 user nova-compute[70374]:     </disk>
Jul 27 09:30:52 user nova-compute[70374]:     <disk type="file" device="cdrom">
Jul 27 09:30:52 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 09:30:52 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk.config"/>
Jul 27 09:30:52 user nova-compute[70374]:       <target dev="sdb" bus="scsi"/>
Jul 27 09:30:52 user nova-compute[70374]:       <address type="drive" controller="0" unit="1"/>
Jul 27 09:30:52 user nova-compute[70374]:     </disk>
Jul 27 09:30:52 user nova-compute[70374]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 27 09:30:52 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:52 user nova-compute[70374]:       <mac address="fa:16:3e:57:6c:c6"/>
Jul 27 09:30:52 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:52 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:52 user nova-compute[70374]:       <target dev="tap626b287e-22"/>
Jul 27 09:30:52 user nova-compute[70374]:     </interface>
Jul 27 09:30:52 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:52 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/console.log" append="off"/>
Jul 27 09:30:52 user nova-compute[70374]:     </serial>
Jul 27 09:30:52 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:52 user nova-compute[70374]:     <video>
Jul 27 09:30:52 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:52 user nova-compute[70374]:     </video>
Jul 27 09:30:52 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:52 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:52 user nova-compute[70374]:     </rng>
Jul 27 09:30:52 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:52 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:52 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:52 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:52 user nova-compute[70374]:   </devices>
Jul 27 09:30:52 user nova-compute[70374]: </domain>
Jul 27 09:30:52 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-860974169',display_name='tempest-AttachSCSIVolumeTestJSON-server-860974169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-860974169',id=8,image_ref='726e1210-3ce3-486f-9417-95adaf9ac235',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2UxiY9xja9j2e+bYNFRInNFJS7DjB/7i9A7rll9a0HowWQT/92Qp4K1SO60+YclaZAVgDJD7MloBXQCsn+BhUVizXOve/ao95EzmtZUBSUTgLTVXF8O7s8qW7tjuxGXQ==',key_name='tempest-keypair-936823846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd638e5400740279443a374e3e570d4',ramdisk_id='',reservation_id='r-010r1p2b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='726e1210-3ce3-486f-9417-95adaf9ac235',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-284147988',owner_user_name='tempest-AttachSCSIVolumeTestJSON-284147988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='103aa251c26c4987814bc5973d86e601',uuid=309c9c26-4a0f-45db-bb3a-595b19f3f627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Converting VIF {"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:6c:c6,bridge_name='br-int',has_traffic_filtering=True,id=626b287e-22ee-49d7-8ec3-c1a0660bd5d8,network=Network(f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626b287e-22') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG os_vif [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:6c:c6,bridge_name='br-int',has_traffic_filtering=True,id=626b287e-22ee-49d7-8ec3-c1a0660bd5d8,network=Network(f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626b287e-22') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap626b287e-22, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap626b287e-22, col_values=(('external_ids', {'iface-id': '626b287e-22ee-49d7-8ec3-c1a0660bd5d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:6c:c6', 'vm-uuid': '309c9c26-4a0f-45db-bb3a-595b19f3f627'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:52 user nova-compute[70374]: INFO os_vif [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:6c:c6,bridge_name='br-int',has_traffic_filtering=True,id=626b287e-22ee-49d7-8ec3-c1a0660bd5d8,network=Network(f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626b287e-22')
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] No BDM found with device name sda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] No VIF found with MAC fa:16:3e:57:6c:c6, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:52 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Using config drive
Jul 27 09:30:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:30:52 user nova-compute[70374]: INFO nova.compute.claims [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Claim successful on node user
Jul 27 09:30:52 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Creating config drive at /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk.config
Jul 27 09:30:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_r1bz5oe {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_r1bz5oe" returned: 0 in 0.089s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Successfully updated port: c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Updated VIF entry in instance network info cache for port 626b287e-22ee-49d7-8ec3-c1a0660bd5d8. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Updating instance_info_cache with network_info: [{"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "refresh_cache-773917c6-56d7-4491-a760-05f51593b7f0" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquired lock "refresh_cache-773917c6-56d7-4491-a760-05f51593b7f0" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6e768fa6-3f82-4722-9d89-996be36124de req-0d92771b-ac1a-4d26-b788-0b0501d97cee service nova] Releasing lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-96b561ef-f164-4582-ba93-f7c38e709268 req-3a319eb8-de57-480f-824a-32735803d19b service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-changed-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-96b561ef-f164-4582-ba93-f7c38e709268 req-3a319eb8-de57-480f-824a-32735803d19b service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Refreshing instance network info cache due to event network-changed-c8fbf870-e2d7-4ec6-be17-98f3d9315f75. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96b561ef-f164-4582-ba93-f7c38e709268 req-3a319eb8-de57-480f-824a-32735803d19b service nova] Acquiring lock "refresh_cache-773917c6-56d7-4491-a760-05f51593b7f0" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.936s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:30:53 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:30:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:30:54 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Creating image(s)
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.212s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.policy [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d33f8cd041046c18af25f56b63b6bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3e52a41c1847b199e6dcd09b676fba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk 1073741824" returned: 0 in 0.059s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Updating instance_info_cache with network_info: [{"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Releasing lock "refresh_cache-773917c6-56d7-4491-a760-05f51593b7f0" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Instance network_info: |[{"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96b561ef-f164-4582-ba93-f7c38e709268 req-3a319eb8-de57-480f-824a-32735803d19b service nova] Acquired lock "refresh_cache-773917c6-56d7-4491-a760-05f51593b7f0" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.network.neutron [req-96b561ef-f164-4582-ba93-f7c38e709268 req-3a319eb8-de57-480f-824a-32735803d19b service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Refreshing network info cache for port c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Start _get_guest_xml network_info=[{"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:54 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:54 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1574025589',display_name='tempest-VolumesActionsTest-instance-1574025589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1574025589',id=10,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d88292245b8d4bbfa07efc8084ae089c',ramdisk_id='',reservation_id='r-dbzwfifo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2082395054',owner_user_name='tempest-VolumesActionsTest-2082395054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:50Z,user_data=None,user_id='459cb24159604669a118a1da67fbdf72',uuid=773917c6-56d7-4491-a760-05f51593b7f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Converting VIF {"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0c:8d,bridge_name='br-int',has_traffic_filtering=True,id=c8fbf870-e2d7-4ec6-be17-98f3d9315f75,network=Network(efa0e322-091b-4b62-b5f9-8a09fa192696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fbf870-e2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.objects.instance [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lazy-loading 'pci_devices' on Instance uuid 773917c6-56d7-4491-a760-05f51593b7f0 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.193s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:54 user nova-compute[70374]:   <uuid>773917c6-56d7-4491-a760-05f51593b7f0</uuid>
Jul 27 09:30:54 user nova-compute[70374]:   <name>instance-0000000a</name>
Jul 27 09:30:54 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:54 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:54 user nova-compute[70374]:   <metadata>
Jul 27 09:30:54 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:54 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:54 user nova-compute[70374]:       <nova:name>tempest-VolumesActionsTest-instance-1574025589</nova:name>
Jul 27 09:30:54 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:54</nova:creationTime>
Jul 27 09:30:54 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:54 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:54 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:54 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:54 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:54 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:54 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:54 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:54 user nova-compute[70374]:         <nova:user uuid="459cb24159604669a118a1da67fbdf72">tempest-VolumesActionsTest-2082395054-project-member</nova:user>
Jul 27 09:30:54 user nova-compute[70374]:         <nova:project uuid="d88292245b8d4bbfa07efc8084ae089c">tempest-VolumesActionsTest-2082395054</nova:project>
Jul 27 09:30:54 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:54 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:54 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:54 user nova-compute[70374]:         <nova:port uuid="c8fbf870-e2d7-4ec6-be17-98f3d9315f75">
Jul 27 09:30:54 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 09:30:54 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:54 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:54 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:54 user nova-compute[70374]:   </metadata>
Jul 27 09:30:54 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:54 user nova-compute[70374]:     <system>
Jul 27 09:30:54 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:54 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:54 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:54 user nova-compute[70374]:       <entry name="serial">773917c6-56d7-4491-a760-05f51593b7f0</entry>
Jul 27 09:30:54 user nova-compute[70374]:       <entry name="uuid">773917c6-56d7-4491-a760-05f51593b7f0</entry>
Jul 27 09:30:54 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:54 user nova-compute[70374]:     </system>
Jul 27 09:30:54 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:54 user nova-compute[70374]:   <os>
Jul 27 09:30:54 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:54 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:54 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:54 user nova-compute[70374]:   </os>
Jul 27 09:30:54 user nova-compute[70374]:   <features>
Jul 27 09:30:54 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:54 user nova-compute[70374]:     <apic/>
Jul 27 09:30:54 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:54 user nova-compute[70374]:   </features>
Jul 27 09:30:54 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:54 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:54 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:54 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:54 user nova-compute[70374]:   </clock>
Jul 27 09:30:54 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:54 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:54 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:54 user nova-compute[70374]:   </cpu>
Jul 27 09:30:54 user nova-compute[70374]:   <devices>
Jul 27 09:30:54 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:54 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:54 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk"/>
Jul 27 09:30:54 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:54 user nova-compute[70374]:     </disk>
Jul 27 09:30:54 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:54 user nova-compute[70374]:       <mac address="fa:16:3e:19:0c:8d"/>
Jul 27 09:30:54 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:54 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:54 user nova-compute[70374]:       <target dev="tapc8fbf870-e2"/>
Jul 27 09:30:54 user nova-compute[70374]:     </interface>
Jul 27 09:30:54 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:54 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/console.log" append="off"/>
Jul 27 09:30:54 user nova-compute[70374]:     </serial>
Jul 27 09:30:54 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:54 user nova-compute[70374]:     <video>
Jul 27 09:30:54 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:54 user nova-compute[70374]:     </video>
Jul 27 09:30:54 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:54 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:54 user nova-compute[70374]:     </rng>
Jul 27 09:30:54 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:54 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:54 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:54 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:54 user nova-compute[70374]:   </devices>
Jul 27 09:30:54 user nova-compute[70374]: </domain>
Jul 27 09:30:54 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1574025589',display_name='tempest-VolumesActionsTest-instance-1574025589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1574025589',id=10,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d88292245b8d4bbfa07efc8084ae089c',ramdisk_id='',reservation_id='r-dbzwfifo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2082395054',owner_user_name='tempest-VolumesActionsTest-2082395054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:50Z,user_data=None,user_id='459cb24159604669a118a1da67fbdf72',uuid=773917c6-56d7-4491-a760-05f51593b7f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Converting VIF {"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0c:8d,bridge_name='br-int',has_traffic_filtering=True,id=c8fbf870-e2d7-4ec6-be17-98f3d9315f75,network=Network(efa0e322-091b-4b62-b5f9-8a09fa192696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fbf870-e2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG os_vif [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0c:8d,bridge_name='br-int',has_traffic_filtering=True,id=c8fbf870-e2d7-4ec6-be17-98f3d9315f75,network=Network(efa0e322-091b-4b62-b5f9-8a09fa192696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fbf870-e2') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8fbf870-e2, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8fbf870-e2, col_values=(('external_ids', {'iface-id': 'c8fbf870-e2d7-4ec6-be17-98f3d9315f75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:0c:8d', 'vm-uuid': '773917c6-56d7-4491-a760-05f51593b7f0'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:54 user nova-compute[70374]: INFO os_vif [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0c:8d,bridge_name='br-int',has_traffic_filtering=True,id=c8fbf870-e2d7-4ec6-be17-98f3d9315f75,network=Network(efa0e322-091b-4b62-b5f9-8a09fa192696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fbf870-e2')
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Cannot resize image /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.objects.instance [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'migration_context' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Ensure instance console log exists: /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] No VIF found with MAC fa:16:3e:19:0c:8d, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-41b5b2c7-2041-4659-9ed7-2b00bd63d498 req-4d82643f-38f2-4ac0-9806-d1ebbd1f85d3 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received event network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-41b5b2c7-2041-4659-9ed7-2b00bd63d498 req-4d82643f-38f2-4ac0-9806-d1ebbd1f85d3 service nova] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-41b5b2c7-2041-4659-9ed7-2b00bd63d498 req-4d82643f-38f2-4ac0-9806-d1ebbd1f85d3 service nova] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-41b5b2c7-2041-4659-9ed7-2b00bd63d498 req-4d82643f-38f2-4ac0-9806-d1ebbd1f85d3 service nova] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-41b5b2c7-2041-4659-9ed7-2b00bd63d498 req-4d82643f-38f2-4ac0-9806-d1ebbd1f85d3 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] No waiting events found dispatching network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:55 user nova-compute[70374]: WARNING nova.compute.manager [req-41b5b2c7-2041-4659-9ed7-2b00bd63d498 req-4d82643f-38f2-4ac0-9806-d1ebbd1f85d3 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received unexpected event network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 for instance with vm_state building and task_state spawning.
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-96b561ef-f164-4582-ba93-f7c38e709268 req-3a319eb8-de57-480f-824a-32735803d19b service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Updated VIF entry in instance network info cache for port c8fbf870-e2d7-4ec6-be17-98f3d9315f75. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-96b561ef-f164-4582-ba93-f7c38e709268 req-3a319eb8-de57-480f-824a-32735803d19b service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Updating instance_info_cache with network_info: [{"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96b561ef-f164-4582-ba93-f7c38e709268 req-3a319eb8-de57-480f-824a-32735803d19b service nova] Releasing lock "refresh_cache-773917c6-56d7-4491-a760-05f51593b7f0" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received event network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] No waiting events found dispatching network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:55 user nova-compute[70374]: WARNING nova.compute.manager [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received unexpected event network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf for instance with vm_state building and task_state spawning.
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received event network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] No waiting events found dispatching network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:55 user nova-compute[70374]: WARNING nova.compute.manager [req-d875d580-3fda-4c0d-8e28-6fa705d1f9f7 req-eb2d8c50-9709-4663-880d-f4701093cce1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received unexpected event network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf for instance with vm_state building and task_state spawning.
Jul 27 09:30:55 user nova-compute[70374]: DEBUG nova.network.neutron [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Successfully created port: 6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-3a7e2013-dede-4b02-97c7-7e03567bee72 req-3fc03cec-2d90-4f3a-81c8-d2174b22afaf service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a7e2013-dede-4b02-97c7-7e03567bee72 req-3fc03cec-2d90-4f3a-81c8-d2174b22afaf service nova] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a7e2013-dede-4b02-97c7-7e03567bee72 req-3fc03cec-2d90-4f3a-81c8-d2174b22afaf service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a7e2013-dede-4b02-97c7-7e03567bee72 req-3fc03cec-2d90-4f3a-81c8-d2174b22afaf service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-3a7e2013-dede-4b02-97c7-7e03567bee72 req-3fc03cec-2d90-4f3a-81c8-d2174b22afaf service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] No waiting events found dispatching network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:57 user nova-compute[70374]: WARNING nova.compute.manager [req-3a7e2013-dede-4b02-97c7-7e03567bee72 req-3fc03cec-2d90-4f3a-81c8-d2174b22afaf service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received unexpected event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 for instance with vm_state building and task_state spawning.
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450257.1023588, d35fe056-8279-479a-a673-6c61e5ec6933 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] VM Resumed (Lifecycle Event)
Jul 27 09:30:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Instance spawned successfully.
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Successfully updated port: 6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquired lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450257.102505, d35fe056-8279-479a-a673-6c61e5ec6933 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] VM Started (Lifecycle Event)
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:30:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-3084a275-9b54-4411-a6a8-135b42edd3be req-0a22029e-5f10-49f4-9675-231112e96867 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received event network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3084a275-9b54-4411-a6a8-135b42edd3be req-0a22029e-5f10-49f4-9675-231112e96867 service nova] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3084a275-9b54-4411-a6a8-135b42edd3be req-0a22029e-5f10-49f4-9675-231112e96867 service nova] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3084a275-9b54-4411-a6a8-135b42edd3be req-0a22029e-5f10-49f4-9675-231112e96867 service nova] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-3084a275-9b54-4411-a6a8-135b42edd3be req-0a22029e-5f10-49f4-9675-231112e96867 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] No waiting events found dispatching network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:57 user nova-compute[70374]: WARNING nova.compute.manager [req-3084a275-9b54-4411-a6a8-135b42edd3be req-0a22029e-5f10-49f4-9675-231112e96867 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received unexpected event network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 for instance with vm_state building and task_state spawning.
Jul 27 09:30:57 user nova-compute[70374]: INFO nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Took 8.81 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:57 user nova-compute[70374]: INFO nova.compute.manager [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Took 11.27 seconds to build instance.
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8efbf7c5-01d1-45b7-8dfb-fe367e033528 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.390s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-3f9093eb-7a98-45d4-9b54-e83a92284eca req-7c93341f-731d-4fb1-ab3f-2a3396c8f2ad service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-changed-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-3f9093eb-7a98-45d4-9b54-e83a92284eca req-7c93341f-731d-4fb1-ab3f-2a3396c8f2ad service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Refreshing instance network info cache due to event network-changed-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3f9093eb-7a98-45d4-9b54-e83a92284eca req-7c93341f-731d-4fb1-ab3f-2a3396c8f2ad service nova] Acquiring lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Releasing lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Instance network_info: |[{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3f9093eb-7a98-45d4-9b54-e83a92284eca req-7c93341f-731d-4fb1-ab3f-2a3396c8f2ad service nova] Acquired lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-3f9093eb-7a98-45d4-9b54-e83a92284eca req-7c93341f-731d-4fb1-ab3f-2a3396c8f2ad service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Refreshing network info cache for port 6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Start _get_guest_xml network_info=[{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:30:57 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:57 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converting VIF {"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9d:c3,bridge_name='br-int',has_traffic_filtering=True,id=6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f,network=Network(158fe9d2-5b60-4b57-bdcb-10de0604f194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9ecfd-f7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.objects.instance [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'pci_devices' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:30:57 user nova-compute[70374]:   <uuid>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</uuid>
Jul 27 09:30:57 user nova-compute[70374]:   <name>instance-0000000b</name>
Jul 27 09:30:57 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:30:57 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:30:57 user nova-compute[70374]:   <metadata>
Jul 27 09:30:57 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:30:57 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:30:57 user nova-compute[70374]:       <nova:name>tempest-device-tagging-server-175106609</nova:name>
Jul 27 09:30:57 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:30:57</nova:creationTime>
Jul 27 09:30:57 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:30:57 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:30:57 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:30:57 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:30:57 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:30:57 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:30:57 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:30:57 user nova-compute[70374]:       <nova:owner>
Jul 27 09:30:57 user nova-compute[70374]:         <nova:user uuid="6d33f8cd041046c18af25f56b63b6bb5">tempest-TaggedAttachmentsTest-493274998-project-member</nova:user>
Jul 27 09:30:57 user nova-compute[70374]:         <nova:project uuid="df3e52a41c1847b199e6dcd09b676fba">tempest-TaggedAttachmentsTest-493274998</nova:project>
Jul 27 09:30:57 user nova-compute[70374]:       </nova:owner>
Jul 27 09:30:57 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:30:57 user nova-compute[70374]:       <nova:ports>
Jul 27 09:30:57 user nova-compute[70374]:         <nova:port uuid="6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f">
Jul 27 09:30:57 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:30:57 user nova-compute[70374]:         </nova:port>
Jul 27 09:30:57 user nova-compute[70374]:       </nova:ports>
Jul 27 09:30:57 user nova-compute[70374]:     </nova:instance>
Jul 27 09:30:57 user nova-compute[70374]:   </metadata>
Jul 27 09:30:57 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:30:57 user nova-compute[70374]:     <system>
Jul 27 09:30:57 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:30:57 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:30:57 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:30:57 user nova-compute[70374]:       <entry name="serial">b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:30:57 user nova-compute[70374]:       <entry name="uuid">b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:30:57 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:30:57 user nova-compute[70374]:     </system>
Jul 27 09:30:57 user nova-compute[70374]:   </sysinfo>
Jul 27 09:30:57 user nova-compute[70374]:   <os>
Jul 27 09:30:57 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:30:57 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:30:57 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:30:57 user nova-compute[70374]:   </os>
Jul 27 09:30:57 user nova-compute[70374]:   <features>
Jul 27 09:30:57 user nova-compute[70374]:     <acpi/>
Jul 27 09:30:57 user nova-compute[70374]:     <apic/>
Jul 27 09:30:57 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:30:57 user nova-compute[70374]:   </features>
Jul 27 09:30:57 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:30:57 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:30:57 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:30:57 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:30:57 user nova-compute[70374]:   </clock>
Jul 27 09:30:57 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:30:57 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:30:57 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:30:57 user nova-compute[70374]:   </cpu>
Jul 27 09:30:57 user nova-compute[70374]:   <devices>
Jul 27 09:30:57 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:30:57 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:30:57 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk"/>
Jul 27 09:30:57 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:30:57 user nova-compute[70374]:     </disk>
Jul 27 09:30:57 user nova-compute[70374]:     <disk type="file" device="cdrom">
Jul 27 09:30:57 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 09:30:57 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.config"/>
Jul 27 09:30:57 user nova-compute[70374]:       <target dev="hda" bus="ide"/>
Jul 27 09:30:57 user nova-compute[70374]:     </disk>
Jul 27 09:30:57 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:30:57 user nova-compute[70374]:       <mac address="fa:16:3e:b2:9d:c3"/>
Jul 27 09:30:57 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:57 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:30:57 user nova-compute[70374]:       <target dev="tap6bd9ecfd-f7"/>
Jul 27 09:30:57 user nova-compute[70374]:     </interface>
Jul 27 09:30:57 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:30:57 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log" append="off"/>
Jul 27 09:30:57 user nova-compute[70374]:     </serial>
Jul 27 09:30:57 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:30:57 user nova-compute[70374]:     <video>
Jul 27 09:30:57 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:30:57 user nova-compute[70374]:     </video>
Jul 27 09:30:57 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:30:57 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:30:57 user nova-compute[70374]:     </rng>
Jul 27 09:30:57 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:30:57 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:30:57 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:30:57 user nova-compute[70374]:     </memballoon>
Jul 27 09:30:57 user nova-compute[70374]:   </devices>
Jul 27 09:30:57 user nova-compute[70374]: </domain>
Jul 27 09:30:57 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converting VIF {"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9d:c3,bridge_name='br-int',has_traffic_filtering=True,id=6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f,network=Network(158fe9d2-5b60-4b57-bdcb-10de0604f194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9ecfd-f7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG os_vif [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9d:c3,bridge_name='br-int',has_traffic_filtering=True,id=6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f,network=Network(158fe9d2-5b60-4b57-bdcb-10de0604f194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9ecfd-f7') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bd9ecfd-f7, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6bd9ecfd-f7, col_values=(('external_ids', {'iface-id': '6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:9d:c3', 'vm-uuid': 'b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:30:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:57 user nova-compute[70374]: INFO os_vif [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9d:c3,bridge_name='br-int',has_traffic_filtering=True,id=6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f,network=Network(158fe9d2-5b60-4b57-bdcb-10de0604f194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9ecfd-f7')
Jul 27 09:30:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No BDM found with device name hda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:30:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No VIF found with MAC fa:16:3e:b2:9d:c3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:30:58 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Using config drive
Jul 27 09:30:58 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Creating config drive at /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.config
Jul 27 09:30:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz_wytjg6 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:30:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz_wytjg6" returned: 0 in 0.084s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:30:58 user nova-compute[70374]: DEBUG nova.network.neutron [req-3f9093eb-7a98-45d4-9b54-e83a92284eca req-7c93341f-731d-4fb1-ab3f-2a3396c8f2ad service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updated VIF entry in instance network info cache for port 6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:30:58 user nova-compute[70374]: DEBUG nova.network.neutron [req-3f9093eb-7a98-45d4-9b54-e83a92284eca req-7c93341f-731d-4fb1-ab3f-2a3396c8f2ad service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:30:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3f9093eb-7a98-45d4-9b54-e83a92284eca req-7c93341f-731d-4fb1-ab3f-2a3396c8f2ad service nova] Releasing lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:30:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450259.035947, 309c9c26-4a0f-45db-bb3a-595b19f3f627 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] VM Resumed (Lifecycle Event)
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Instance spawned successfully.
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450259.037737, 309c9c26-4a0f-45db-bb3a-595b19f3f627 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] VM Started (Lifecycle Event)
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-876278b4-c511-47b5-9f6e-7897f7b82dcd req-6232c384-7514-40df-88f9-bb1783354333 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-876278b4-c511-47b5-9f6e-7897f7b82dcd req-6232c384-7514-40df-88f9-bb1783354333 service nova] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-876278b4-c511-47b5-9f6e-7897f7b82dcd req-6232c384-7514-40df-88f9-bb1783354333 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-876278b4-c511-47b5-9f6e-7897f7b82dcd req-6232c384-7514-40df-88f9-bb1783354333 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-876278b4-c511-47b5-9f6e-7897f7b82dcd req-6232c384-7514-40df-88f9-bb1783354333 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] No waiting events found dispatching network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:30:59 user nova-compute[70374]: WARNING nova.compute.manager [req-876278b4-c511-47b5-9f6e-7897f7b82dcd req-6232c384-7514-40df-88f9-bb1783354333 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received unexpected event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 for instance with vm_state building and task_state spawning.
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Took 12.18 seconds to spawn the instance on the hypervisor.
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Took 14.20 seconds to build instance.
Jul 27 09:30:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-19982597-4a94-4f10-8524-9853250946dc tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.511s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450259.7877195, 773917c6-56d7-4491-a760-05f51593b7f0 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] VM Resumed (Lifecycle Event)
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Instance spawned successfully.
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450259.798499, 773917c6-56d7-4491-a760-05f51593b7f0 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] VM Started (Lifecycle Event)
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:30:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:30:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:31:00 user nova-compute[70374]: INFO nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Took 10.30 seconds to spawn the instance on the hypervisor.
Jul 27 09:31:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:31:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:00 user nova-compute[70374]: INFO nova.compute.manager [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Took 13.61 seconds to build instance.
Jul 27 09:31:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-393b9621-444f-44f7-9d2d-5e5143fb26b6 tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "773917c6-56d7-4491-a760-05f51593b7f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.121s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] No waiting events found dispatching network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:31:01 user nova-compute[70374]: WARNING nova.compute.manager [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received unexpected event network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f for instance with vm_state building and task_state spawning.
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] No waiting events found dispatching network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:31:01 user nova-compute[70374]: WARNING nova.compute.manager [req-ad96762b-e06e-43e9-9c8d-8e768e7eea97 req-656a178a-6b21-4df4-bc9d-13fded490b29 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received unexpected event network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f for instance with vm_state building and task_state spawning.
Jul 27 09:31:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Skipping network cache update for instance because it is Building. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:31:01 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 04a990b9-ed32-41e9-b384-f0886e8d1b49 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updating instance_info_cache with network_info: [{"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450262.9877958, b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:31:02 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] VM Resumed (Lifecycle Event)
Jul 27 09:31:02 user nova-compute[70374]: DEBUG nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:31:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:31:03 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Instance spawned successfully.
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:03 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450262.9914532, b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:31:03 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] VM Started (Lifecycle Event)
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:31:03 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:31:03 user nova-compute[70374]: INFO nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Took 9.20 seconds to spawn the instance on the hypervisor.
Jul 27 09:31:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:03 user nova-compute[70374]: INFO nova.compute.manager [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Took 10.62 seconds to build instance.
Jul 27 09:31:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-22a0c6f6-9a97-473e-b18a-9708c1273e24 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.778s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:08 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:31:08 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7304MB free_disk=25.77625274658203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 42f4c546-47e4-485b-be29-4081c7557bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 309c9c26-4a0f-45db-bb3a-595b19f3f627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance d35fe056-8279-479a-a673-6c61e5ec6933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 773917c6-56d7-4491-a760-05f51593b7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:08 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 09:31:09 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:31:09 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:31:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:31:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.012s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:31:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:31:52 user nova-compute[70374]: INFO nova.compute.claims [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Claim successful on node user
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:31:52 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.policy [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa672f231aae45d6a68bddddf583dcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6c645430b147a0983e499772a43790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:31:52 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Creating image(s)
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "/opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "/opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk 1073741824" returned: 0 in 0.046s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Cannot resize image /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG nova.objects.instance [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'migration_context' on Instance uuid ea21f129-1e0a-4ad1-b516-c2a8f92835b7 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Ensure instance console log exists: /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Successfully created port: faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Successfully updated port: faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquired lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-400c5804-cd73-4545-85c5-94fc45c9bea3 req-90afc4ed-8b83-469b-b355-43b8f07de3dd service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-changed-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-400c5804-cd73-4545-85c5-94fc45c9bea3 req-90afc4ed-8b83-469b-b355-43b8f07de3dd service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Refreshing instance network info cache due to event network-changed-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-400c5804-cd73-4545-85c5-94fc45c9bea3 req-90afc4ed-8b83-469b-b355-43b8f07de3dd service nova] Acquiring lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Updating instance_info_cache with network_info: [{"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Releasing lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Instance network_info: |[{"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-400c5804-cd73-4545-85c5-94fc45c9bea3 req-90afc4ed-8b83-469b-b355-43b8f07de3dd service nova] Acquired lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.neutron [req-400c5804-cd73-4545-85c5-94fc45c9bea3 req-90afc4ed-8b83-469b-b355-43b8f07de3dd service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Refreshing network info cache for port faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Start _get_guest_xml network_info=[{"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:31:54 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:31:54 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-161038782',display_name='tempest-TestStampPattern-server-161038782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-161038782',id=12,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj2SFnPDau6vQCtjDQG1ZxRhv34b+wb9sn5YbvH/SZ654hrAREIUSioV28ip+GznAtPzx4FbU600mwPtKiSdblyqS0Oc7MrVQ7evq+7Ird+40EGlZ1xk19BS7xqljznJA==',key_name='tempest-TestStampPattern-355396374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b6c645430b147a0983e499772a43790',ramdisk_id='',reservation_id='r-siobf74j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-795018650',owner_user_name='tempest-TestStampPattern-795018650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:31:53Z,user_data=None,user_id='fa672f231aae45d6a68bddddf583dcde',uuid=ea21f129-1e0a-4ad1-b516-c2a8f92835b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converting VIF {"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d2:3d,bridge_name='br-int',has_traffic_filtering=True,id=faecacb1-2e14-4d38-8c90-bfb3ff5e23a7,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaecacb1-2e') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.objects.instance [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'pci_devices' on Instance uuid ea21f129-1e0a-4ad1-b516-c2a8f92835b7 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:31:54 user nova-compute[70374]:   <uuid>ea21f129-1e0a-4ad1-b516-c2a8f92835b7</uuid>
Jul 27 09:31:54 user nova-compute[70374]:   <name>instance-0000000c</name>
Jul 27 09:31:54 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:31:54 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:31:54 user nova-compute[70374]:   <metadata>
Jul 27 09:31:54 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:31:54 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:31:54 user nova-compute[70374]:       <nova:name>tempest-TestStampPattern-server-161038782</nova:name>
Jul 27 09:31:54 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:31:54</nova:creationTime>
Jul 27 09:31:54 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:31:54 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:31:54 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:31:54 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:31:54 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:31:54 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:31:54 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:31:54 user nova-compute[70374]:       <nova:owner>
Jul 27 09:31:54 user nova-compute[70374]:         <nova:user uuid="fa672f231aae45d6a68bddddf583dcde">tempest-TestStampPattern-795018650-project-member</nova:user>
Jul 27 09:31:54 user nova-compute[70374]:         <nova:project uuid="3b6c645430b147a0983e499772a43790">tempest-TestStampPattern-795018650</nova:project>
Jul 27 09:31:54 user nova-compute[70374]:       </nova:owner>
Jul 27 09:31:54 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:31:54 user nova-compute[70374]:       <nova:ports>
Jul 27 09:31:54 user nova-compute[70374]:         <nova:port uuid="faecacb1-2e14-4d38-8c90-bfb3ff5e23a7">
Jul 27 09:31:54 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:31:54 user nova-compute[70374]:         </nova:port>
Jul 27 09:31:54 user nova-compute[70374]:       </nova:ports>
Jul 27 09:31:54 user nova-compute[70374]:     </nova:instance>
Jul 27 09:31:54 user nova-compute[70374]:   </metadata>
Jul 27 09:31:54 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:31:54 user nova-compute[70374]:     <system>
Jul 27 09:31:54 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:31:54 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:31:54 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:31:54 user nova-compute[70374]:       <entry name="serial">ea21f129-1e0a-4ad1-b516-c2a8f92835b7</entry>
Jul 27 09:31:54 user nova-compute[70374]:       <entry name="uuid">ea21f129-1e0a-4ad1-b516-c2a8f92835b7</entry>
Jul 27 09:31:54 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:31:54 user nova-compute[70374]:     </system>
Jul 27 09:31:54 user nova-compute[70374]:   </sysinfo>
Jul 27 09:31:54 user nova-compute[70374]:   <os>
Jul 27 09:31:54 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:31:54 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:31:54 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:31:54 user nova-compute[70374]:   </os>
Jul 27 09:31:54 user nova-compute[70374]:   <features>
Jul 27 09:31:54 user nova-compute[70374]:     <acpi/>
Jul 27 09:31:54 user nova-compute[70374]:     <apic/>
Jul 27 09:31:54 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:31:54 user nova-compute[70374]:   </features>
Jul 27 09:31:54 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:31:54 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:31:54 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:31:54 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:31:54 user nova-compute[70374]:   </clock>
Jul 27 09:31:54 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:31:54 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:31:54 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:31:54 user nova-compute[70374]:   </cpu>
Jul 27 09:31:54 user nova-compute[70374]:   <devices>
Jul 27 09:31:54 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:31:54 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:31:54 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk"/>
Jul 27 09:31:54 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:31:54 user nova-compute[70374]:     </disk>
Jul 27 09:31:54 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:31:54 user nova-compute[70374]:       <mac address="fa:16:3e:37:d2:3d"/>
Jul 27 09:31:54 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:31:54 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:31:54 user nova-compute[70374]:       <target dev="tapfaecacb1-2e"/>
Jul 27 09:31:54 user nova-compute[70374]:     </interface>
Jul 27 09:31:54 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:31:54 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/console.log" append="off"/>
Jul 27 09:31:54 user nova-compute[70374]:     </serial>
Jul 27 09:31:54 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:31:54 user nova-compute[70374]:     <video>
Jul 27 09:31:54 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:31:54 user nova-compute[70374]:     </video>
Jul 27 09:31:54 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:31:54 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:31:54 user nova-compute[70374]:     </rng>
Jul 27 09:31:54 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:31:54 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:31:54 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:31:54 user nova-compute[70374]:     </memballoon>
Jul 27 09:31:54 user nova-compute[70374]:   </devices>
Jul 27 09:31:54 user nova-compute[70374]: </domain>
Jul 27 09:31:54 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-161038782',display_name='tempest-TestStampPattern-server-161038782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-161038782',id=12,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj2SFnPDau6vQCtjDQG1ZxRhv34b+wb9sn5YbvH/SZ654hrAREIUSioV28ip+GznAtPzx4FbU600mwPtKiSdblyqS0Oc7MrVQ7evq+7Ird+40EGlZ1xk19BS7xqljznJA==',key_name='tempest-TestStampPattern-355396374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b6c645430b147a0983e499772a43790',ramdisk_id='',reservation_id='r-siobf74j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-795018650',owner_user_name='tempest-TestStampPattern-795018650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:31:53Z,user_data=None,user_id='fa672f231aae45d6a68bddddf583dcde',uuid=ea21f129-1e0a-4ad1-b516-c2a8f92835b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converting VIF {"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d2:3d,bridge_name='br-int',has_traffic_filtering=True,id=faecacb1-2e14-4d38-8c90-bfb3ff5e23a7,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaecacb1-2e') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG os_vif [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d2:3d,bridge_name='br-int',has_traffic_filtering=True,id=faecacb1-2e14-4d38-8c90-bfb3ff5e23a7,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaecacb1-2e') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfaecacb1-2e, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfaecacb1-2e, col_values=(('external_ids', {'iface-id': 'faecacb1-2e14-4d38-8c90-bfb3ff5e23a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:d2:3d', 'vm-uuid': 'ea21f129-1e0a-4ad1-b516-c2a8f92835b7'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:54 user nova-compute[70374]: INFO os_vif [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d2:3d,bridge_name='br-int',has_traffic_filtering=True,id=faecacb1-2e14-4d38-8c90-bfb3ff5e23a7,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaecacb1-2e')
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:31:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No VIF found with MAC fa:16:3e:37:d2:3d, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:31:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-400c5804-cd73-4545-85c5-94fc45c9bea3 req-90afc4ed-8b83-469b-b355-43b8f07de3dd service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Updated VIF entry in instance network info cache for port faecacb1-2e14-4d38-8c90-bfb3ff5e23a7. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:31:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-400c5804-cd73-4545-85c5-94fc45c9bea3 req-90afc4ed-8b83-469b-b355-43b8f07de3dd service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Updating instance_info_cache with network_info: [{"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:31:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-400c5804-cd73-4545-85c5-94fc45c9bea3 req-90afc4ed-8b83-469b-b355-43b8f07de3dd service nova] Releasing lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-cb90a621-9927-4054-8a57-1d1df087a54e req-54b627f2-948e-4570-8870-91eaf468dd0f service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cb90a621-9927-4054-8a57-1d1df087a54e req-54b627f2-948e-4570-8870-91eaf468dd0f service nova] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cb90a621-9927-4054-8a57-1d1df087a54e req-54b627f2-948e-4570-8870-91eaf468dd0f service nova] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cb90a621-9927-4054-8a57-1d1df087a54e req-54b627f2-948e-4570-8870-91eaf468dd0f service nova] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-cb90a621-9927-4054-8a57-1d1df087a54e req-54b627f2-948e-4570-8870-91eaf468dd0f service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] No waiting events found dispatching network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:31:56 user nova-compute[70374]: WARNING nova.compute.manager [req-cb90a621-9927-4054-8a57-1d1df087a54e req-54b627f2-948e-4570-8870-91eaf468dd0f service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received unexpected event network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 for instance with vm_state building and task_state spawning.
Jul 27 09:31:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:31:58 user nova-compute[70374]: INFO nova.compute.claims [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Claim successful on node user
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450318.5513124, ea21f129-1e0a-4ad1-b516-c2a8f92835b7 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:31:58 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] VM Resumed (Lifecycle Event)
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:31:58 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Instance spawned successfully.
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-81bcf4ae-20a2-4263-a39e-5a90cf3ea2f6 req-d012ed75-9386-4086-b150-64ba05ad2647 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-81bcf4ae-20a2-4263-a39e-5a90cf3ea2f6 req-d012ed75-9386-4086-b150-64ba05ad2647 service nova] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-81bcf4ae-20a2-4263-a39e-5a90cf3ea2f6 req-d012ed75-9386-4086-b150-64ba05ad2647 service nova] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-81bcf4ae-20a2-4263-a39e-5a90cf3ea2f6 req-d012ed75-9386-4086-b150-64ba05ad2647 service nova] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-81bcf4ae-20a2-4263-a39e-5a90cf3ea2f6 req-d012ed75-9386-4086-b150-64ba05ad2647 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] No waiting events found dispatching network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:31:58 user nova-compute[70374]: WARNING nova.compute.manager [req-81bcf4ae-20a2-4263-a39e-5a90cf3ea2f6 req-d012ed75-9386-4086-b150-64ba05ad2647 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received unexpected event network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 for instance with vm_state building and task_state spawning.
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:31:58 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450318.5555477, ea21f129-1e0a-4ad1-b516-c2a8f92835b7 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:31:58 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] VM Started (Lifecycle Event)
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:31:58 user nova-compute[70374]: INFO nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Took 5.75 seconds to spawn the instance on the hypervisor.
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:31:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:31:58 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:31:58 user nova-compute[70374]: INFO nova.compute.manager [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Took 6.54 seconds to build instance.
Jul 27 09:31:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-14c59844-099e-4337-9779-48a202e18404 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.657s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:31:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.policy [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '544aa4a40ff941c2a52b24faa08a0d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e935bb36794aa98eb3e94c30e647d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:31:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Creating image(s)
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "/opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "/opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "/opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk 1073741824" returned: 0 in 0.058s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Successfully created port: 75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:31:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:00 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Cannot resize image /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:32:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lazy-loading 'migration_context' on Instance uuid a72e9d21-b1f4-4e61-8875-c72d7ce88a32 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:32:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Ensure instance console log exists: /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:32:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Successfully updated port: 75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "refresh_cache-a72e9d21-b1f4-4e61-8875-c72d7ce88a32" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquired lock "refresh_cache-a72e9d21-b1f4-4e61-8875-c72d7ce88a32" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-2fe06278-d4f7-4f30-801c-a2f18a8c0d52 req-4fe8af49-3a6e-49b7-8532-433b5086353b service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received event network-changed-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-2fe06278-d4f7-4f30-801c-a2f18a8c0d52 req-4fe8af49-3a6e-49b7-8532-433b5086353b service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Refreshing instance network info cache due to event network-changed-75f39855-7414-4b71-a4a8-553502aa8627. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2fe06278-d4f7-4f30-801c-a2f18a8c0d52 req-4fe8af49-3a6e-49b7-8532-433b5086353b service nova] Acquiring lock "refresh_cache-a72e9d21-b1f4-4e61-8875-c72d7ce88a32" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Updating instance_info_cache with network_info: [{"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Releasing lock "refresh_cache-a72e9d21-b1f4-4e61-8875-c72d7ce88a32" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Instance network_info: |[{"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2fe06278-d4f7-4f30-801c-a2f18a8c0d52 req-4fe8af49-3a6e-49b7-8532-433b5086353b service nova] Acquired lock "refresh_cache-a72e9d21-b1f4-4e61-8875-c72d7ce88a32" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.neutron [req-2fe06278-d4f7-4f30-801c-a2f18a8c0d52 req-4fe8af49-3a6e-49b7-8532-433b5086353b service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Refreshing network info cache for port 75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Start _get_guest_xml network_info=[{"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:32:01 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:32:01 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1038287225',display_name='tempest-ServersNegativeTestJSON-server-1038287225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1038287225',id=13,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65e935bb36794aa98eb3e94c30e647d9',ramdisk_id='',reservation_id='r-ocrv8sa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1865798359',owner_user_name='tempest-ServersNegativeTestJSON-1865798359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:31:59Z,user_data=None,user_id='544aa4a40ff941c2a52b24faa08a0d29',uuid=a72e9d21-b1f4-4e61-8875-c72d7ce88a32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converting VIF {"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5c:8c,bridge_name='br-int',has_traffic_filtering=True,id=75f39855-7414-4b71-a4a8-553502aa8627,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f39855-74') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lazy-loading 'pci_devices' on Instance uuid a72e9d21-b1f4-4e61-8875-c72d7ce88a32 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:32:01 user nova-compute[70374]:   <uuid>a72e9d21-b1f4-4e61-8875-c72d7ce88a32</uuid>
Jul 27 09:32:01 user nova-compute[70374]:   <name>instance-0000000d</name>
Jul 27 09:32:01 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:32:01 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:32:01 user nova-compute[70374]:   <metadata>
Jul 27 09:32:01 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:32:01 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:32:01 user nova-compute[70374]:       <nova:name>tempest-ServersNegativeTestJSON-server-1038287225</nova:name>
Jul 27 09:32:01 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:32:01</nova:creationTime>
Jul 27 09:32:01 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:32:01 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:32:01 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:32:01 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:32:01 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:32:01 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:32:01 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:32:01 user nova-compute[70374]:       <nova:owner>
Jul 27 09:32:01 user nova-compute[70374]:         <nova:user uuid="544aa4a40ff941c2a52b24faa08a0d29">tempest-ServersNegativeTestJSON-1865798359-project-member</nova:user>
Jul 27 09:32:01 user nova-compute[70374]:         <nova:project uuid="65e935bb36794aa98eb3e94c30e647d9">tempest-ServersNegativeTestJSON-1865798359</nova:project>
Jul 27 09:32:01 user nova-compute[70374]:       </nova:owner>
Jul 27 09:32:01 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:32:01 user nova-compute[70374]:       <nova:ports>
Jul 27 09:32:01 user nova-compute[70374]:         <nova:port uuid="75f39855-7414-4b71-a4a8-553502aa8627">
Jul 27 09:32:01 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 09:32:01 user nova-compute[70374]:         </nova:port>
Jul 27 09:32:01 user nova-compute[70374]:       </nova:ports>
Jul 27 09:32:01 user nova-compute[70374]:     </nova:instance>
Jul 27 09:32:01 user nova-compute[70374]:   </metadata>
Jul 27 09:32:01 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:32:01 user nova-compute[70374]:     <system>
Jul 27 09:32:01 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:32:01 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:32:01 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:32:01 user nova-compute[70374]:       <entry name="serial">a72e9d21-b1f4-4e61-8875-c72d7ce88a32</entry>
Jul 27 09:32:01 user nova-compute[70374]:       <entry name="uuid">a72e9d21-b1f4-4e61-8875-c72d7ce88a32</entry>
Jul 27 09:32:01 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:32:01 user nova-compute[70374]:     </system>
Jul 27 09:32:01 user nova-compute[70374]:   </sysinfo>
Jul 27 09:32:01 user nova-compute[70374]:   <os>
Jul 27 09:32:01 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:32:01 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:32:01 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:32:01 user nova-compute[70374]:   </os>
Jul 27 09:32:01 user nova-compute[70374]:   <features>
Jul 27 09:32:01 user nova-compute[70374]:     <acpi/>
Jul 27 09:32:01 user nova-compute[70374]:     <apic/>
Jul 27 09:32:01 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:32:01 user nova-compute[70374]:   </features>
Jul 27 09:32:01 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:32:01 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:32:01 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:32:01 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:32:01 user nova-compute[70374]:   </clock>
Jul 27 09:32:01 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:32:01 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:32:01 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:32:01 user nova-compute[70374]:   </cpu>
Jul 27 09:32:01 user nova-compute[70374]:   <devices>
Jul 27 09:32:01 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:32:01 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:32:01 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk"/>
Jul 27 09:32:01 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:32:01 user nova-compute[70374]:     </disk>
Jul 27 09:32:01 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:32:01 user nova-compute[70374]:       <mac address="fa:16:3e:34:5c:8c"/>
Jul 27 09:32:01 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:32:01 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:32:01 user nova-compute[70374]:       <target dev="tap75f39855-74"/>
Jul 27 09:32:01 user nova-compute[70374]:     </interface>
Jul 27 09:32:01 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:32:01 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/console.log" append="off"/>
Jul 27 09:32:01 user nova-compute[70374]:     </serial>
Jul 27 09:32:01 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:32:01 user nova-compute[70374]:     <video>
Jul 27 09:32:01 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:32:01 user nova-compute[70374]:     </video>
Jul 27 09:32:01 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:32:01 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:32:01 user nova-compute[70374]:     </rng>
Jul 27 09:32:01 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:32:01 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:32:01 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:32:01 user nova-compute[70374]:     </memballoon>
Jul 27 09:32:01 user nova-compute[70374]:   </devices>
Jul 27 09:32:01 user nova-compute[70374]: </domain>
Jul 27 09:32:01 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1038287225',display_name='tempest-ServersNegativeTestJSON-server-1038287225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1038287225',id=13,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65e935bb36794aa98eb3e94c30e647d9',ramdisk_id='',reservation_id='r-ocrv8sa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1865798359',owner_user_name='tempest-ServersNegativeTestJSON-1865798359-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:31:59Z,user_data=None,user_id='544aa4a40ff941c2a52b24faa08a0d29',uuid=a72e9d21-b1f4-4e61-8875-c72d7ce88a32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converting VIF {"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5c:8c,bridge_name='br-int',has_traffic_filtering=True,id=75f39855-7414-4b71-a4a8-553502aa8627,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f39855-74') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG os_vif [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5c:8c,bridge_name='br-int',has_traffic_filtering=True,id=75f39855-7414-4b71-a4a8-553502aa8627,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f39855-74') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75f39855-74, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75f39855-74, col_values=(('external_ids', {'iface-id': '75f39855-7414-4b71-a4a8-553502aa8627', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:5c:8c', 'vm-uuid': 'a72e9d21-b1f4-4e61-8875-c72d7ce88a32'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:01 user nova-compute[70374]: INFO os_vif [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5c:8c,bridge_name='br-int',has_traffic_filtering=True,id=75f39855-7414-4b71-a4a8-553502aa8627,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f39855-74')
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] No VIF found with MAC fa:16:3e:34:5c:8c, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:02 user nova-compute[70374]: DEBUG nova.network.neutron [req-2fe06278-d4f7-4f30-801c-a2f18a8c0d52 req-4fe8af49-3a6e-49b7-8532-433b5086353b service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Updated VIF entry in instance network info cache for port 75f39855-7414-4b71-a4a8-553502aa8627. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:02 user nova-compute[70374]: DEBUG nova.network.neutron [req-2fe06278-d4f7-4f30-801c-a2f18a8c0d52 req-4fe8af49-3a6e-49b7-8532-433b5086353b service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Updating instance_info_cache with network_info: [{"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2fe06278-d4f7-4f30-801c-a2f18a8c0d52 req-4fe8af49-3a6e-49b7-8532-433b5086353b service nova] Releasing lock "refresh_cache-a72e9d21-b1f4-4e61-8875-c72d7ce88a32" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:02 user nova-compute[70374]: INFO nova.compute.manager [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Rescuing
Jul 27 09:32:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquired lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:02 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-7965d2ce-aad0-4ae9-8205-d52f299cfbb3 req-d743d8be-cc09-42e8-b8d6-7dc86004bcc4 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received event network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7965d2ce-aad0-4ae9-8205-d52f299cfbb3 req-d743d8be-cc09-42e8-b8d6-7dc86004bcc4 service nova] Acquiring lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7965d2ce-aad0-4ae9-8205-d52f299cfbb3 req-d743d8be-cc09-42e8-b8d6-7dc86004bcc4 service nova] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7965d2ce-aad0-4ae9-8205-d52f299cfbb3 req-d743d8be-cc09-42e8-b8d6-7dc86004bcc4 service nova] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-7965d2ce-aad0-4ae9-8205-d52f299cfbb3 req-d743d8be-cc09-42e8-b8d6-7dc86004bcc4 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] No waiting events found dispatching network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:03 user nova-compute[70374]: WARNING nova.compute.manager [req-7965d2ce-aad0-4ae9-8205-d52f299cfbb3 req-d743d8be-cc09-42e8-b8d6-7dc86004bcc4 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received unexpected event network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 for instance with vm_state building and task_state spawning.
Jul 27 09:32:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updating instance_info_cache with network_info: [{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Releasing lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:32:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Instance destroyed successfully.
Jul 27 09:32:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Attempting rescue
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70374) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Instance directory exists: not creating {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 09:32:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Creating image(s)
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue" returned: 0 in 0.060s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'migration_context' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Start _get_guest_xml network_info=[{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:ef:0f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '35458adf-261a-4e0b-a4db-b243619b2394', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'resources' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:04 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:32:04 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457979026',display_name='tempest-ServerRescueNegativeTestJSON-server-1457979026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457979026',id=4,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-x508h1z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:30Z,user_data=None,user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=6ae93f34-ce7e-4ae4-a5ba-36508361bd54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:ef:0f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:ef:0f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:0f:b2,bridge_name='br-int',has_traffic_filtering=True,id=ce2809b5-cc30-4a29-9770-7df186b16406,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2809b5-cc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:32:04 user nova-compute[70374]:   <uuid>6ae93f34-ce7e-4ae4-a5ba-36508361bd54</uuid>
Jul 27 09:32:04 user nova-compute[70374]:   <name>instance-00000004</name>
Jul 27 09:32:04 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:32:04 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:32:04 user nova-compute[70374]:   <metadata>
Jul 27 09:32:04 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:32:04 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:32:04 user nova-compute[70374]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1457979026</nova:name>
Jul 27 09:32:04 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:32:04</nova:creationTime>
Jul 27 09:32:04 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:32:04 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:32:04 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:32:04 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:32:04 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:32:04 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:32:04 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:32:04 user nova-compute[70374]:       <nova:owner>
Jul 27 09:32:04 user nova-compute[70374]:         <nova:user uuid="d059c8dff3644f3c9c0c54498a4d78f7">tempest-ServerRescueNegativeTestJSON-241559119-project-member</nova:user>
Jul 27 09:32:04 user nova-compute[70374]:         <nova:project uuid="d8acda82ef3f428fbb93847922a213d1">tempest-ServerRescueNegativeTestJSON-241559119</nova:project>
Jul 27 09:32:04 user nova-compute[70374]:       </nova:owner>
Jul 27 09:32:04 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:32:04 user nova-compute[70374]:       <nova:ports>
Jul 27 09:32:04 user nova-compute[70374]:         <nova:port uuid="ce2809b5-cc30-4a29-9770-7df186b16406">
Jul 27 09:32:04 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:32:04 user nova-compute[70374]:         </nova:port>
Jul 27 09:32:04 user nova-compute[70374]:       </nova:ports>
Jul 27 09:32:04 user nova-compute[70374]:     </nova:instance>
Jul 27 09:32:04 user nova-compute[70374]:   </metadata>
Jul 27 09:32:04 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:32:04 user nova-compute[70374]:     <system>
Jul 27 09:32:04 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:32:04 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:32:04 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:32:04 user nova-compute[70374]:       <entry name="serial">6ae93f34-ce7e-4ae4-a5ba-36508361bd54</entry>
Jul 27 09:32:04 user nova-compute[70374]:       <entry name="uuid">6ae93f34-ce7e-4ae4-a5ba-36508361bd54</entry>
Jul 27 09:32:04 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:32:04 user nova-compute[70374]:     </system>
Jul 27 09:32:04 user nova-compute[70374]:   </sysinfo>
Jul 27 09:32:04 user nova-compute[70374]:   <os>
Jul 27 09:32:04 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:32:04 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:32:04 user nova-compute[70374]:   </os>
Jul 27 09:32:04 user nova-compute[70374]:   <features>
Jul 27 09:32:04 user nova-compute[70374]:     <acpi/>
Jul 27 09:32:04 user nova-compute[70374]:     <apic/>
Jul 27 09:32:04 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:32:04 user nova-compute[70374]:   </features>
Jul 27 09:32:04 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:32:04 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:32:04 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:32:04 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:32:04 user nova-compute[70374]:   </clock>
Jul 27 09:32:04 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:32:04 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:32:04 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:32:04 user nova-compute[70374]:   </cpu>
Jul 27 09:32:04 user nova-compute[70374]:   <devices>
Jul 27 09:32:04 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:32:04 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:32:04 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue"/>
Jul 27 09:32:04 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:32:04 user nova-compute[70374]:     </disk>
Jul 27 09:32:04 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:32:04 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:32:04 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk"/>
Jul 27 09:32:04 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:32:04 user nova-compute[70374]:     </disk>
Jul 27 09:32:04 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:32:04 user nova-compute[70374]:       <mac address="fa:16:3e:ef:0f:b2"/>
Jul 27 09:32:04 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:32:04 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:32:04 user nova-compute[70374]:       <target dev="tapce2809b5-cc"/>
Jul 27 09:32:04 user nova-compute[70374]:     </interface>
Jul 27 09:32:04 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:32:04 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/console.log" append="off"/>
Jul 27 09:32:04 user nova-compute[70374]:     </serial>
Jul 27 09:32:04 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:32:04 user nova-compute[70374]:     <video>
Jul 27 09:32:04 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:32:04 user nova-compute[70374]:     </video>
Jul 27 09:32:04 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:32:04 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:32:04 user nova-compute[70374]:     </rng>
Jul 27 09:32:04 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:32:04 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:32:04 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:32:04 user nova-compute[70374]:     </memballoon>
Jul 27 09:32:04 user nova-compute[70374]:   </devices>
Jul 27 09:32:04 user nova-compute[70374]: </domain>
Jul 27 09:32:04 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:32:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Instance destroyed successfully.
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No VIF found with MAC fa:16:3e:ef:0f:b2, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450325.2985382, a72e9d21-b1f4-4e61-8875-c72d7ce88a32 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:32:05 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] VM Resumed (Lifecycle Event)
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:32:05 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Instance spawned successfully.
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:05 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450325.3079975, a72e9d21-b1f4-4e61-8875-c72d7ce88a32 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:32:05 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] VM Started (Lifecycle Event)
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:32:05 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:32:05 user nova-compute[70374]: INFO nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Took 6.09 seconds to spawn the instance on the hypervisor.
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received event network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Acquiring lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] No waiting events found dispatching network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:05 user nova-compute[70374]: WARNING nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received unexpected event network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 for instance with vm_state building and task_state spawning.
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-unplugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-unplugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:05 user nova-compute[70374]: WARNING nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-unplugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state active and task_state rescuing.
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:05 user nova-compute[70374]: WARNING nova.compute.manager [req-bd4958a1-3a49-40f8-8cf4-aa8110977b72 req-1df54f40-ab3e-4205-81a9-7daf9965824e service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state active and task_state rescuing.
Jul 27 09:32:05 user nova-compute[70374]: INFO nova.compute.manager [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Took 7.11 seconds to build instance.
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a6149f09-bd40-40f2-91e2-9582f3b42434 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.224s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG nova.objects.instance [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lazy-loading 'flavor' on Instance uuid 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:06 user nova-compute[70374]: INFO nova.compute.manager [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Attaching volume 4aac502f-2b4f-4e7f-83c0-30e91f701ca5 to /dev/vdb
Jul 27 09:32:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG os_brick.utils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:06 user nova-compute[70374]: INFO oslo.privsep.daemon [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmplxfwilyz/privsep.sock']
Jul 27 09:32:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:06 user sudo[82117]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmplxfwilyz/privsep.sock
Jul 27 09:32:06 user sudo[82117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 09:32:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-6c84a190-c75d-4d6f-9a75-97ab203f8c8f req-4987108d-732b-476d-aea5-ab0367301c71 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-changed-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-6c84a190-c75d-4d6f-9a75-97ab203f8c8f req-4987108d-732b-476d-aea5-ab0367301c71 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Refreshing instance network info cache due to event network-changed-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6c84a190-c75d-4d6f-9a75-97ab203f8c8f req-4987108d-732b-476d-aea5-ab0367301c71 service nova] Acquiring lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6c84a190-c75d-4d6f-9a75-97ab203f8c8f req-4987108d-732b-476d-aea5-ab0367301c71 service nova] Acquired lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG nova.network.neutron [req-6c84a190-c75d-4d6f-9a75-97ab203f8c8f req-4987108d-732b-476d-aea5-ab0367301c71 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Refreshing network info cache for port e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.compute.manager [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.compute.manager [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:08 user nova-compute[70374]: WARNING nova.compute.manager [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state active and task_state rescuing.
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.compute.manager [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.compute.manager [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:08 user nova-compute[70374]: WARNING nova.compute.manager [req-fcf0ac23-63e7-41d3-842b-8bd39c33a046 req-27de16ff-f12d-49f7-a485-c7058018ff61 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state active and task_state rescuing.
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:08 user sudo[82117]: pam_unix(sudo:session): session closed for user root
Jul 27 09:32:08 user nova-compute[70374]: INFO oslo.privsep.daemon [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Spawned new privsep daemon via rootwrap
Jul 27 09:32:08 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 09:32:08 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 09:32:08 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 27 09:32:08 user nova-compute[70374]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82164
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c828de-274f-42f4-bed1-251cf69127ae]: (2,) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[755a30e7-455b-44bd-bca9-079c4da80a4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:08 user nova-compute[70374]: WARNING os_brick.initiator.connectors.nvmeof [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[766a28bf-bff9-4a49-a61c-81611a75111b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a56d33-2b2f-434e-a579-d46e9c30fd01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c08481-ba51-4714-a540-2c4feada2898]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:08 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[394179ce-7af2-4529-a03d-09abbb56d5f2]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG os_brick.utils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] <== get_connector_properties: return (2297ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Updating existing volume attachment record: cd4f606e-45ca-4312-a29e-c9e2cffc972d {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.network.neutron [req-6c84a190-c75d-4d6f-9a75-97ab203f8c8f req-4987108d-732b-476d-aea5-ab0367301c71 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updated VIF entry in instance network info cache for port e6dc311e-c8d0-4b0c-bf42-96919f9d6f02. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.network.neutron [req-6c84a190-c75d-4d6f-9a75-97ab203f8c8f req-4987108d-732b-476d-aea5-ab0367301c71 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updating instance_info_cache with network_info: [{"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6c84a190-c75d-4d6f-9a75-97ab203f8c8f req-4987108d-732b-476d-aea5-ab0367301c71 service nova] Releasing lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450328.8782072, 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:32:08 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] VM Resumed (Lifecycle Event)
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0f5e32e3-00b9-4455-b913-8f4c7e73be2e tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:08 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:32:09 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 09:32:09 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450328.8924384, 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:32:09 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] VM Started (Lifecycle Event)
Jul 27 09:32:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-eba497ad-998a-4e29-9387-6a7ae29481f4 req-95f442ba-3c88-4846-91c1-81932966edad service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-changed-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-eba497ad-998a-4e29-9387-6a7ae29481f4 req-95f442ba-3c88-4846-91c1-81932966edad service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Refreshing instance network info cache due to event network-changed-b825d9b4-15c4-4b47-a3f7-af9838d09458. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eba497ad-998a-4e29-9387-6a7ae29481f4 req-95f442ba-3c88-4846-91c1-81932966edad service nova] Acquiring lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eba497ad-998a-4e29-9387-6a7ae29481f4 req-95f442ba-3c88-4846-91c1-81932966edad service nova] Acquired lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG nova.network.neutron [req-eba497ad-998a-4e29-9387-6a7ae29481f4 req-95f442ba-3c88-4846-91c1-81932966edad service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Refreshing network info cache for port b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG nova.network.neutron [req-eba497ad-998a-4e29-9387-6a7ae29481f4 req-95f442ba-3c88-4846-91c1-81932966edad service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updated VIF entry in instance network info cache for port b825d9b4-15c4-4b47-a3f7-af9838d09458. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG nova.network.neutron [req-eba497ad-998a-4e29-9387-6a7ae29481f4 req-95f442ba-3c88-4846-91c1-81932966edad service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updating instance_info_cache with network_info: [{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eba497ad-998a-4e29-9387-6a7ae29481f4 req-95f442ba-3c88-4846-91c1-81932966edad service nova] Releasing lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:12 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:32:12 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=6811MB free_disk=25.62173080444336GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.698s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 42f4c546-47e4-485b-be29-4081c7557bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 309c9c26-4a0f-45db-bb3a-595b19f3f627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance d35fe056-8279-479a-a673-6c61e5ec6933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 773917c6-56d7-4491-a760-05f51593b7f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance a72e9d21-b1f4-4e61-8875-c72d7ce88a32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:12 user nova-compute[70374]: INFO nova.compute.manager [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Attaching volume ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 to /dev/vdb
Jul 27 09:32:12 user nova-compute[70374]: DEBUG os_brick.utils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2823574-8d30-4b50-a576-6274fc158aa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b96a026-65c3-411d-b265-41e43cc57351]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3456f0b-a6c9-49e7-89bf-d50b72d8a978]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f225bf8-46d5-4d3b-8e47-d06f5d4e931e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:12 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d049177-c907-4a4f-9223-486a5a38f3e0]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG os_brick.utils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updating existing volume attachment record: 2be6bf71-4cb0-402d-a975-55e5458524e9 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:32:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.797s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:32:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG nova.objects.instance [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:14 user nova-compute[70374]: INFO nova.compute.manager [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Attaching volume 788f71f6-0aca-4da9-a915-59560f5cb291 to /dev/vdb
Jul 27 09:32:14 user nova-compute[70374]: DEBUG os_brick.utils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2184cad-4a7c-41e1-bf25-6c21661634ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[086f6da8-92c4-4619-b042-2a0c8410c865]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cf04de-3468-431c-a0e1-72bd278a30cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c86acf-66d2-4d4c-8478-058f438412c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:14 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:32:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722dd70-fccd-4c02-8c13-d9be84b17ef9]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG os_brick.utils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:14 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updating existing volume attachment record: 3329de24-8de5-4111-84db-b9a71d949e64 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connector [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Factory for ISCSI on None {{(pid=70374) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huTvDrlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:17 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:17 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:17 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888aadf-faad-46b6-9e69-5bdaee9ea622]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:32:17 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bc23bc-d8e6-4f38-8b26-9e49e77e55e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5] added
Jul 27 09:32:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7731a08b-7de3-40d7-aa07-bc4ea0bf401c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[70368c6e-00c9-45bd-bd0c-c71dd04bd7ff]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huTvDrlQ {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huTvDrlQ" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb24055-4d7a-4b78-84c8-bee6511442cd]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'huTvDrlQ'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3631ae05-f0fc-4e46-84cd-8a92f5c926c4]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f12b8f-8f7b-4077-b5c5-c991eb243c39]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:32:18 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:32:18 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:18 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 09:32:18 user nova-compute[70374]: 
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4456e8e2-121b-49c9-a0b3-60f7f6438a08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5, portal: 172.16.0.220,3260]
Jul 27 09:32:18 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4674df-b4f0-4abb-b6b6-520cda4040ea]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8ca2c5-29e1-49cc-9a25-5a4d6034a7a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)
Jul 27 09:32:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)
Jul 27 09:32:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[271c9ef4-a29f-46bd-b20e-f229f3acc48f]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huTvDrlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23633653466643234', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633653466643234', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG nova.objects.instance [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lazy-loading 'flavor' on Instance uuid 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:32:19 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:19 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:32:19 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:19 user nova-compute[70374]:   <serial>4aac502f-2b4f-4e7f-83c0-30e91f701ca5</serial>
Jul 27 09:32:19 user nova-compute[70374]: </disk>
Jul 27 09:32:19 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] No VIF found with MAC fa:16:3e:de:fb:c0, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWyzhePO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:19 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:19 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:19 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad79c61-19f4-42cf-83f4-f119ae6e7cbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:32:19 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[141fc557-3a98-4426-a3f0-f6ea1a0fa61e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251] added
Jul 27 09:32:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9bbcc-ccbb-4e48-a2dd-37ee1e8c5640]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[22063849-fd5a-489e-9960-8ad43503e9d2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWyzhePO {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5f197139-a16a-49e2-9a42-dd4d2757d842 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.755s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWyzhePO" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3502cd4-9105-4252-8f02-358a01d72a80]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWyzhePO'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2e645a-e599-4c1c-8438-5323bdc4ee77]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f991d653-052c-4a64-ba60-0a594ac0b723]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)
Jul 27 09:32:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)
Jul 27 09:32:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baff6c5-3de8-4138-85f4-2f9bdeff82ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251, portal: 172.16.0.220,3260]
Jul 27 09:32:19 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ca1a6d-4686-4a8f-9ac9-bd52b40ad305]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb082599-7ef2-4e3f-8ad7-e6b455358f7b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)
Jul 27 09:32:20 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)
Jul 27 09:32:20 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc1a199-d60b-4a56-9c83-344da921443f]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWyzhePO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:20 user nova-compute[70374]: INFO nova.compute.manager [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Terminating instance
Jul 27 09:32:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-1c9498dc-4b52-4893-8c89-b48845d1fb97 req-1e3d3c85-5538-46f0-8a49-897df55ebf3e service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received event network-vif-unplugged-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1c9498dc-4b52-4893-8c89-b48845d1fb97 req-1e3d3c85-5538-46f0-8a49-897df55ebf3e service nova] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1c9498dc-4b52-4893-8c89-b48845d1fb97 req-1e3d3c85-5538-46f0-8a49-897df55ebf3e service nova] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1c9498dc-4b52-4893-8c89-b48845d1fb97 req-1e3d3c85-5538-46f0-8a49-897df55ebf3e service nova] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-1c9498dc-4b52-4893-8c89-b48845d1fb97 req-1e3d3c85-5538-46f0-8a49-897df55ebf3e service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] No waiting events found dispatching network-vif-unplugged-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-1c9498dc-4b52-4893-8c89-b48845d1fb97 req-1e3d3c85-5538-46f0-8a49-897df55ebf3e service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received event network-vif-unplugged-98a9819c-4270-4b75-b851-635a3b19a7b4 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26562613965376139', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562613965376139', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:32:21 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:21 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:32:21 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:21 user nova-compute[70374]:   <serial>ad9cc86c-1deb-4294-bdbf-5cce1d5b6251</serial>
Jul 27 09:32:21 user nova-compute[70374]: </disk>
Jul 27 09:32:21 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:32:21 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Instance destroyed successfully.
Jul 27 09:32:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lazy-loading 'resources' on Instance uuid 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1737227100',display_name='tempest-DeleteServersTestJSON-server-1737227100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1737227100',id=3,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d99bef1aeee4c6090e60bdbb0ecbeda',ramdisk_id='',reservation_id='r-vup3cqqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-322957873',owner_user_name='tempest-DeleteServersTestJSON-322957873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:30:27Z,user_data=None,user_id='c87590f95d1147f48a94203d8be751ab',uuid=6a5593cd-3ab6-4859-b0fb-33a0ed702dc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Converting VIF {"id": "98a9819c-4270-4b75-b851-635a3b19a7b4", "address": "fa:16:3e:de:fb:c0", "network": {"id": "6faafed3-97ab-43b5-bf25-0d0a468935f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-754617940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d99bef1aeee4c6090e60bdbb0ecbeda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a9819c-42", "ovs_interfaceid": "98a9819c-4270-4b75-b851-635a3b19a7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:c0,bridge_name='br-int',has_traffic_filtering=True,id=98a9819c-4270-4b75-b851-635a3b19a7b4,network=Network(6faafed3-97ab-43b5-bf25-0d0a468935f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a9819c-42') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG os_vif [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:c0,bridge_name='br-int',has_traffic_filtering=True,id=98a9819c-4270-4b75-b851-635a3b19a7b4,network=Network(6faafed3-97ab-43b5-bf25-0d0a468935f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a9819c-42') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98a9819c-42, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:32:21 user nova-compute[70374]: INFO os_vif [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fb:c0,bridge_name='br-int',has_traffic_filtering=True,id=98a9819c-4270-4b75-b851-635a3b19a7b4,network=Network(6faafed3-97ab-43b5-bf25-0d0a468935f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a9819c-42')
Jul 27 09:32:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huTvDrlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:21 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[011b182b-0013-40a4-9f02-15b73f81c6db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:32:22 user nova-compute[70374]: No targets found.
Jul 27 09:32:22 user nova-compute[70374]: iSNS:
Jul 27 09:32:22 user nova-compute[70374]: No targets found.
Jul 27 09:32:22 user nova-compute[70374]: STATIC:
Jul 27 09:32:22 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5
Jul 27 09:32:22 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:22 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:22 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:32:22 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:22 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:22 user nova-compute[70374]: FIRMWARE:
Jul 27 09:32:22 user nova-compute[70374]: No targets found.
Jul 27 09:32:22 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:32:22 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:32:22 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No VIF found with MAC fa:16:3e:21:44:72, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cbdef6-c48c-40ff-a9b2-706f81d40164]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[92481d8a-75eb-47ca-b605-dc2811749c69]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)
Jul 27 09:32:22 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:22 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 (non-flash)
Jul 27 09:32:22 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:22 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc3413f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57cb708-a4f9-435b-87ac-044267ba9cf5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[69763200-f0f7-4d97-82b3-0bc1dee74ca6]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a4ab3a6d-8345-46b6-9576-d3f98c09a05a tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.787s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4705dbfd-37dd-4d28-8bb5-5c186007a7e0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8fcf62-5f95-426e-ab53-e13c556efbe6]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e28b6-7c7b-4437-bc5a-b5408a72fdec]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[861d569d-732c-4a3a-86ee-c57d4fbbae2a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5, portal: 172.16.0.220,3260]
Jul 27 09:32:22 user nova-compute[70374]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:22 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aac502f-2b4f-4e7f-83c0-30e91f701ca5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1348e65-9c52-4688-a268-787002d30ba1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] <== disconnect_volume: return (377ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:32:22 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Deleting instance files /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8_del
Jul 27 09:32:22 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Deletion of /opt/stack/data/nova/instances/6a5593cd-3ab6-4859-b0fb-33a0ed702dc8_del complete
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70374) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 27 09:32:22 user nova-compute[70374]: INFO nova.virt.libvirt.host [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] UEFI support detected
Jul 27 09:32:22 user nova-compute[70374]: INFO nova.compute.manager [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Took 2.02 seconds to destroy the instance on the hypervisor.
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-1d7b5a4e-7729-41bf-80c4-ff910a186e58 req-f41c051b-b4f6-4b8a-bfcf-11632132ecec service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received event network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1d7b5a4e-7729-41bf-80c4-ff910a186e58 req-f41c051b-b4f6-4b8a-bfcf-11632132ecec service nova] Acquiring lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1d7b5a4e-7729-41bf-80c4-ff910a186e58 req-f41c051b-b4f6-4b8a-bfcf-11632132ecec service nova] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1d7b5a4e-7729-41bf-80c4-ff910a186e58 req-f41c051b-b4f6-4b8a-bfcf-11632132ecec service nova] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-1d7b5a4e-7729-41bf-80c4-ff910a186e58 req-f41c051b-b4f6-4b8a-bfcf-11632132ecec service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] No waiting events found dispatching network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:22 user nova-compute[70374]: WARNING nova.compute.manager [req-1d7b5a4e-7729-41bf-80c4-ff910a186e58 req-f41c051b-b4f6-4b8a-bfcf-11632132ecec service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received unexpected event network-vif-plugged-98a9819c-4270-4b75-b851-635a3b19a7b4 for instance with vm_state active and task_state deleting.
Jul 27 09:32:23 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:23 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Took 0.61 seconds to deallocate network for instance.
Jul 27 09:32:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba32ca44-33bc-4054-a015-45c244dd7a31 req-168b3e6a-7c0e-4e63-9723-85235f854762 service nova] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Received event network-vif-deleted-98a9819c-4270-4b75-b851-635a3b19a7b4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:23 user nova-compute[70374]: INFO nova.compute.manager [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Took 0.76 seconds to detach 1 volumes for instance.
Jul 27 09:32:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:24 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Deleted allocations for instance 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1ff87b29-7a6d-4d36-bbb3-39f654063099 tempest-DeleteServersTestJSON-322957873 tempest-DeleteServersTestJSON-322957873-project-member] Lock "6a5593cd-3ab6-4859-b0fb-33a0ed702dc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.096s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmCwbdGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:24 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:24 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:24 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[95434537-dcea-4e3f-83bc-7c74b1a04358]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:32:24 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc114099-ef0f-426e-b221-285e11c607c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291] added
Jul 27 09:32:24 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb06026-489c-4951-b884-130439ebbef9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81bbec3-12ef-450b-aa90-91b1fc722956]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmCwbdGB {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmCwbdGB" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed530971-fbf0-4235-baa9-c3c8b7d52527]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmCwbdGB'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[18743241-b930-48eb-85f8-f1d99a6e7e75]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d749973-9ef7-4071-9309-48c57359a1bd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:24 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:24 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b83a01c-4a7a-4f32-872d-cf5bb9af77e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260]
Jul 27 09:32:25 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:25 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6ba0f6-f3f8-4e1d-8291-d79be277c2e1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75ab3c9-504f-4c16-9a7e-616c295b5a65]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:25 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:25 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:25 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:25 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf19f538-e6a0-4d81-b0fe-521dce155987]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: None {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "2e225354-053f-48f5-ad3f-6662b627d531" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "2e225354-053f-48f5-ad3f-6662b627d531" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:32:25 user nova-compute[70374]: INFO nova.compute.claims [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Claim successful on node user
Jul 27 09:32:25 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:32:25 user nova-compute[70374]: DEBUG nova.network.neutron [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:32:25 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:32:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.policy [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c1d49c23b0045d881d9f47e33447162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaa69b3745a435795aa636ccddec3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:32:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Creating image(s)
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "/opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "/opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmCwbdGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26635356331636336', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635356331636336', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.objects.instance [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:32:26 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:26 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:32:26 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:26 user nova-compute[70374]:   <serial>788f71f6-0aca-4da9-a915-59560f5cb291</serial>
Jul 27 09:32:26 user nova-compute[70374]: </disk>
Jul 27 09:32:26 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.310s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk 1073741824" returned: 0 in 0.048s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No VIF found with MAC fa:16:3e:b2:af:a6, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Successfully created port: ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3fe386c4-9839-4cc6-9451-5e770a2e358c tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.297s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Cannot resize image /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.objects.instance [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'migration_context' on Instance uuid 2e225354-053f-48f5-ad3f-6662b627d531 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Ensure instance console log exists: /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Successfully updated port: ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquired lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-1bd132d5-7620-41ed-ba7b-54b01313aeac req-55be9905-71d1-4105-a511-b4f5ad7c6c8b service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received event network-changed-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-1bd132d5-7620-41ed-ba7b-54b01313aeac req-55be9905-71d1-4105-a511-b4f5ad7c6c8b service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Refreshing instance network info cache due to event network-changed-ddf41035-1805-4fde-b4cf-d86ab3e59c3b. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1bd132d5-7620-41ed-ba7b-54b01313aeac req-55be9905-71d1-4105-a511-b4f5ad7c6c8b service nova] Acquiring lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f88ccdd6-0832-48c7-b6ce-bc904bd31c87 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f88ccdd6-0832-48c7-b6ce-bc904bd31c87 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f88ccdd6-0832-48c7-b6ce-bc904bd31c87 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f88ccdd6-0832-48c7-b6ce-bc904bd31c87 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70374) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 09:32:27 user nova-compute[70374]: DEBUG nova.objects.instance [None req-f88ccdd6-0832-48c7-b6ce-bc904bd31c87 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.network.neutron [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Updating instance_info_cache with network_info: [{"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Releasing lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Instance network_info: |[{"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1bd132d5-7620-41ed-ba7b-54b01313aeac req-55be9905-71d1-4105-a511-b4f5ad7c6c8b service nova] Acquired lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-1bd132d5-7620-41ed-ba7b-54b01313aeac req-55be9905-71d1-4105-a511-b4f5ad7c6c8b service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Refreshing network info cache for port ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Start _get_guest_xml network_info=[{"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:32:28 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:32:28 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-471243575',display_name='tempest-AttachVolumeNegativeTest-server-471243575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-471243575',id=14,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXIUeFJxpF4vk5nlGGsHNsBOgmU9WA3rEQ6vxDmkBZP7AGy3dWxt/NMowMl08/WRjc5o5ePL2B6OPh8GFtYgtYo1IQP06pzdbpul/oSVpQqD1ny9pUHoKY28t+y4OcZng==',key_name='tempest-keypair-254621140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-w8tuz66i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=2e225354-053f-48f5-ad3f-6662b627d531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=ddf41035-1805-4fde-b4cf-d86ab3e59c3b,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf41035-18') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.objects.instance [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e225354-053f-48f5-ad3f-6662b627d531 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:32:28 user nova-compute[70374]:   <uuid>2e225354-053f-48f5-ad3f-6662b627d531</uuid>
Jul 27 09:32:28 user nova-compute[70374]:   <name>instance-0000000e</name>
Jul 27 09:32:28 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:32:28 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:32:28 user nova-compute[70374]:   <metadata>
Jul 27 09:32:28 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:32:28 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:32:28 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeNegativeTest-server-471243575</nova:name>
Jul 27 09:32:28 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:32:28</nova:creationTime>
Jul 27 09:32:28 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:32:28 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:32:28 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:32:28 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:32:28 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:32:28 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:32:28 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:32:28 user nova-compute[70374]:       <nova:owner>
Jul 27 09:32:28 user nova-compute[70374]:         <nova:user uuid="4c1d49c23b0045d881d9f47e33447162">tempest-AttachVolumeNegativeTest-305502590-project-member</nova:user>
Jul 27 09:32:28 user nova-compute[70374]:         <nova:project uuid="bfaa69b3745a435795aa636ccddec3af">tempest-AttachVolumeNegativeTest-305502590</nova:project>
Jul 27 09:32:28 user nova-compute[70374]:       </nova:owner>
Jul 27 09:32:28 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:32:28 user nova-compute[70374]:       <nova:ports>
Jul 27 09:32:28 user nova-compute[70374]:         <nova:port uuid="ddf41035-1805-4fde-b4cf-d86ab3e59c3b">
Jul 27 09:32:28 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 09:32:28 user nova-compute[70374]:         </nova:port>
Jul 27 09:32:28 user nova-compute[70374]:       </nova:ports>
Jul 27 09:32:28 user nova-compute[70374]:     </nova:instance>
Jul 27 09:32:28 user nova-compute[70374]:   </metadata>
Jul 27 09:32:28 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:32:28 user nova-compute[70374]:     <system>
Jul 27 09:32:28 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:32:28 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:32:28 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:32:28 user nova-compute[70374]:       <entry name="serial">2e225354-053f-48f5-ad3f-6662b627d531</entry>
Jul 27 09:32:28 user nova-compute[70374]:       <entry name="uuid">2e225354-053f-48f5-ad3f-6662b627d531</entry>
Jul 27 09:32:28 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:32:28 user nova-compute[70374]:     </system>
Jul 27 09:32:28 user nova-compute[70374]:   </sysinfo>
Jul 27 09:32:28 user nova-compute[70374]:   <os>
Jul 27 09:32:28 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:32:28 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:32:28 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:32:28 user nova-compute[70374]:   </os>
Jul 27 09:32:28 user nova-compute[70374]:   <features>
Jul 27 09:32:28 user nova-compute[70374]:     <acpi/>
Jul 27 09:32:28 user nova-compute[70374]:     <apic/>
Jul 27 09:32:28 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:32:28 user nova-compute[70374]:   </features>
Jul 27 09:32:28 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:32:28 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:32:28 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:32:28 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:32:28 user nova-compute[70374]:   </clock>
Jul 27 09:32:28 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:32:28 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:32:28 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:32:28 user nova-compute[70374]:   </cpu>
Jul 27 09:32:28 user nova-compute[70374]:   <devices>
Jul 27 09:32:28 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:32:28 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:32:28 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk"/>
Jul 27 09:32:28 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:32:28 user nova-compute[70374]:     </disk>
Jul 27 09:32:28 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:32:28 user nova-compute[70374]:       <mac address="fa:16:3e:e4:cc:69"/>
Jul 27 09:32:28 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:32:28 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:32:28 user nova-compute[70374]:       <target dev="tapddf41035-18"/>
Jul 27 09:32:28 user nova-compute[70374]:     </interface>
Jul 27 09:32:28 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:32:28 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/console.log" append="off"/>
Jul 27 09:32:28 user nova-compute[70374]:     </serial>
Jul 27 09:32:28 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:32:28 user nova-compute[70374]:     <video>
Jul 27 09:32:28 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:32:28 user nova-compute[70374]:     </video>
Jul 27 09:32:28 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:32:28 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:32:28 user nova-compute[70374]:     </rng>
Jul 27 09:32:28 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:32:28 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:32:28 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:32:28 user nova-compute[70374]:     </memballoon>
Jul 27 09:32:28 user nova-compute[70374]:   </devices>
Jul 27 09:32:28 user nova-compute[70374]: </domain>
Jul 27 09:32:28 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-471243575',display_name='tempest-AttachVolumeNegativeTest-server-471243575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-471243575',id=14,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXIUeFJxpF4vk5nlGGsHNsBOgmU9WA3rEQ6vxDmkBZP7AGy3dWxt/NMowMl08/WRjc5o5ePL2B6OPh8GFtYgtYo1IQP06pzdbpul/oSVpQqD1ny9pUHoKY28t+y4OcZng==',key_name='tempest-keypair-254621140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-w8tuz66i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=2e225354-053f-48f5-ad3f-6662b627d531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=ddf41035-1805-4fde-b4cf-d86ab3e59c3b,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf41035-18') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG os_vif [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=ddf41035-1805-4fde-b4cf-d86ab3e59c3b,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf41035-18') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddf41035-18, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapddf41035-18, col_values=(('external_ids', {'iface-id': 'ddf41035-1805-4fde-b4cf-d86ab3e59c3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:cc:69', 'vm-uuid': '2e225354-053f-48f5-ad3f-6662b627d531'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:28 user nova-compute[70374]: INFO os_vif [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=ddf41035-1805-4fde-b4cf-d86ab3e59c3b,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf41035-18')
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No VIF found with MAC fa:16:3e:e4:cc:69, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-1bd132d5-7620-41ed-ba7b-54b01313aeac req-55be9905-71d1-4105-a511-b4f5ad7c6c8b service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Updated VIF entry in instance network info cache for port ddf41035-1805-4fde-b4cf-d86ab3e59c3b. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-1bd132d5-7620-41ed-ba7b-54b01313aeac req-55be9905-71d1-4105-a511-b4f5ad7c6c8b service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Updating instance_info_cache with network_info: [{"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1bd132d5-7620-41ed-ba7b-54b01313aeac req-55be9905-71d1-4105-a511-b4f5ad7c6c8b service nova] Releasing lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:29 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance destroyed successfully.
Jul 27 09:32:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f88ccdd6-0832-48c7-b6ce-bc904bd31c87 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f88ccdd6-0832-48c7-b6ce-bc904bd31c87 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.423s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:29 user nova-compute[70374]: WARNING nova.compute.manager [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state stopped and task_state None.
Jul 27 09:32:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:29 user nova-compute[70374]: WARNING nova.compute.manager [req-b204dae1-befa-4208-85e7-7cdccb5f88c0 req-85732936-808d-4351-9d2a-b3627076df73 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state stopped and task_state None.
Jul 27 09:32:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-d9437a69-5202-4cbd-913d-b9f1b2ae4e6d req-ddeaf04c-d1bf-4480-8146-bfe0d9381459 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received event network-changed-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-d9437a69-5202-4cbd-913d-b9f1b2ae4e6d req-ddeaf04c-d1bf-4480-8146-bfe0d9381459 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Refreshing instance network info cache due to event network-changed-cc9444e6-2840-433c-b7c9-c0df023f6e43. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d9437a69-5202-4cbd-913d-b9f1b2ae4e6d req-ddeaf04c-d1bf-4480-8146-bfe0d9381459 service nova] Acquiring lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d9437a69-5202-4cbd-913d-b9f1b2ae4e6d req-ddeaf04c-d1bf-4480-8146-bfe0d9381459 service nova] Acquired lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG nova.network.neutron [req-d9437a69-5202-4cbd-913d-b9f1b2ae4e6d req-ddeaf04c-d1bf-4480-8146-bfe0d9381459 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Refreshing network info cache for port cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG nova.network.neutron [req-d9437a69-5202-4cbd-913d-b9f1b2ae4e6d req-ddeaf04c-d1bf-4480-8146-bfe0d9381459 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updated VIF entry in instance network info cache for port cc9444e6-2840-433c-b7c9-c0df023f6e43. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG nova.network.neutron [req-d9437a69-5202-4cbd-913d-b9f1b2ae4e6d req-ddeaf04c-d1bf-4480-8146-bfe0d9381459 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updating instance_info_cache with network_info: [{"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d9437a69-5202-4cbd-913d-b9f1b2ae4e6d req-ddeaf04c-d1bf-4480-8146-bfe0d9381459 service nova] Releasing lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450352.1567166, 2e225354-053f-48f5-ad3f-6662b627d531 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:32:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] VM Resumed (Lifecycle Event)
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:32:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Instance spawned successfully.
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:32:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450352.1580963, 2e225354-053f-48f5-ad3f-6662b627d531 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:32:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] VM Started (Lifecycle Event)
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:32:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:32:32 user nova-compute[70374]: INFO nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Took 6.19 seconds to spawn the instance on the hypervisor.
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:32 user nova-compute[70374]: INFO nova.compute.manager [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Took 7.01 seconds to build instance.
Jul 27 09:32:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3926d077-4dad-4892-b624-90c9fb8cf216 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "2e225354-053f-48f5-ad3f-6662b627d531" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.097s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received event network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] Acquiring lock "2e225354-053f-48f5-ad3f-6662b627d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] No waiting events found dispatching network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:32 user nova-compute[70374]: WARNING nova.compute.manager [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received unexpected event network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b for instance with vm_state active and task_state None.
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received event network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] Acquiring lock "2e225354-053f-48f5-ad3f-6662b627d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] No waiting events found dispatching network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:32 user nova-compute[70374]: WARNING nova.compute.manager [req-476e16c0-dd92-482e-8033-83da6794fadf req-6fd8b993-f863-43b2-ba68-588341b0c30d service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received unexpected event network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b for instance with vm_state active and task_state None.
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG nova.objects.instance [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'flavor' on Instance uuid 42f4c546-47e4-485b-be29-4081c7557bad {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:33 user nova-compute[70374]: INFO nova.compute.manager [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Attaching volume 6ae2fa33-45a0-4d20-bbaf-a51427718f3c to /dev/vdb
Jul 27 09:32:33 user nova-compute[70374]: DEBUG os_brick.utils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728b0e5-761f-47ac-95b0-a2f311ed04ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6e18d-474e-42d0-a59a-f370ccdd1bef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c857977-3191-45ad-9635-8238b7ec44ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b861c6-6c60-463b-9014-d4a5f026aa6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:33 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:32:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d054211-02b8-48c9-b2e2-a2a11ce75860]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG os_brick.utils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:33 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updating existing volume attachment record: 7fccd7db-a1e1-42d0-acd3-c082af2b8fe9 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:32:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-06400f19-d10c-49be-8a4b-931225694726 req-e2efc802-427b-4daa-96c6-4e1240e0af5e service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received event network-changed-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-06400f19-d10c-49be-8a4b-931225694726 req-e2efc802-427b-4daa-96c6-4e1240e0af5e service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Refreshing instance network info cache due to event network-changed-626b287e-22ee-49d7-8ec3-c1a0660bd5d8. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-06400f19-d10c-49be-8a4b-931225694726 req-e2efc802-427b-4daa-96c6-4e1240e0af5e service nova] Acquiring lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-06400f19-d10c-49be-8a4b-931225694726 req-e2efc802-427b-4daa-96c6-4e1240e0af5e service nova] Acquired lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-06400f19-d10c-49be-8a4b-931225694726 req-e2efc802-427b-4daa-96c6-4e1240e0af5e service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Refreshing network info cache for port 626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-06400f19-d10c-49be-8a4b-931225694726 req-e2efc802-427b-4daa-96c6-4e1240e0af5e service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Updated VIF entry in instance network info cache for port 626b287e-22ee-49d7-8ec3-c1a0660bd5d8. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-06400f19-d10c-49be-8a4b-931225694726 req-e2efc802-427b-4daa-96c6-4e1240e0af5e service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Updating instance_info_cache with network_info: [{"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-06400f19-d10c-49be-8a4b-931225694726 req-e2efc802-427b-4daa-96c6-4e1240e0af5e service nova] Releasing lock "refresh_cache-309c9c26-4a0f-45db-bb3a-595b19f3f627" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:36 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450341.6068213, 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:32:36 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] VM Stopped (Lifecycle Event)
Jul 27 09:32:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e4e4fa06-b0f4-4e37-bbbe-9205f6e2bbd0 None None] [instance: 6a5593cd-3ab6-4859-b0fb-33a0ed702dc8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-3ee3fd74-0deb-4423-8ba6-20a1d9399c09 req-2c632ff0-78d8-43d2-a908-03ccad4432c9 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received event network-changed-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-3ee3fd74-0deb-4423-8ba6-20a1d9399c09 req-2c632ff0-78d8-43d2-a908-03ccad4432c9 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Refreshing instance network info cache due to event network-changed-018c2bfb-405c-4bba-a54f-e8ea773e57bf. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3ee3fd74-0deb-4423-8ba6-20a1d9399c09 req-2c632ff0-78d8-43d2-a908-03ccad4432c9 service nova] Acquiring lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3ee3fd74-0deb-4423-8ba6-20a1d9399c09 req-2c632ff0-78d8-43d2-a908-03ccad4432c9 service nova] Acquired lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:37 user nova-compute[70374]: DEBUG nova.network.neutron [req-3ee3fd74-0deb-4423-8ba6-20a1d9399c09 req-2c632ff0-78d8-43d2-a908-03ccad4432c9 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Refreshing network info cache for port 018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lazy-loading 'flavor' on Instance uuid d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:38 user nova-compute[70374]: INFO nova.compute.manager [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Attaching volume 25fa94b4-c6dc-4dbd-add9-e3a58523baac to /dev/vdb
Jul 27 09:32:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-3ee3fd74-0deb-4423-8ba6-20a1d9399c09 req-2c632ff0-78d8-43d2-a908-03ccad4432c9 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Updated VIF entry in instance network info cache for port 018c2bfb-405c-4bba-a54f-e8ea773e57bf. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-3ee3fd74-0deb-4423-8ba6-20a1d9399c09 req-2c632ff0-78d8-43d2-a908-03ccad4432c9 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Updating instance_info_cache with network_info: [{"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3ee3fd74-0deb-4423-8ba6-20a1d9399c09 req-2c632ff0-78d8-43d2-a908-03ccad4432c9 service nova] Releasing lock "refresh_cache-d35fe056-8279-479a-a673-6c61e5ec6933" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG os_brick.utils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d8883f-632c-493f-8263-735853dbdf72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1ac474-c2e1-45d8-a5fe-ff5f4e5b8c81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f184057-10d2-486a-bb3f-f95ea4427791]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd10740e-9b6f-4e45-ad3f-4bbaf0c5fc1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:38 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:32:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b213c1c-02eb-4b65-8c48-092a6b737d0e]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG os_brick.utils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:38 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Updating existing volume attachment record: 13abfe22-c4d5-47a4-943f-3c4a9aa930de {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG nova.objects.instance [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lazy-loading 'flavor' on Instance uuid 309c9c26-4a0f-45db-bb3a-595b19f3f627 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:39 user nova-compute[70374]: INFO nova.compute.manager [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Attaching volume 0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e to /dev/sdc
Jul 27 09:32:39 user nova-compute[70374]: DEBUG os_brick.utils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd818fd-b708-47b1-b95b-031bfdb665a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f11d17-d521-4415-9de0-929e3e0659d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d7f6bf-a235-498a-9b15-76ac98863e3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[85174f4a-dff3-40a1-a1b7-f942d5a4ae19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:39 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:32:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0603a4-b0a9-4df7-8b5f-3600ccd536f0]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG os_brick.utils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:39 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Updating existing volume attachment record: 4e610672-d79f-4134-b5c6-ecf3cea4031d {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:32:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:32:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdaFcWLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:40 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:40 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:40 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:32:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef85fe4-4b2a-42df-8f39-6b6cb79c8d2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:32:40 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fecb278-0cc7-487b-88af-16d85d16e3a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c] added
Jul 27 09:32:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15cb9e7-8b5e-4061-a9b3-9f4492356036]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0cdcea-2c24-4ff9-98c5-8241237e1b06]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdaFcWLo {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdaFcWLo" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[403f2747-ca7c-470f-bee5-d7fea1178b18]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdaFcWLo'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[61546b20-ffcf-47c5-974a-aea3c6947afb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48076d4-1027-41f3-bb7c-25360f3fe09f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:41 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:41 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2497cca-8c17-4eba-bf47-c74743beda60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c, portal: 172.16.0.220,3260]
Jul 27 09:32:41 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab4b54b-df69-441d-8818-3f9c8c828c49]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c20821-5cdd-4481-b408-670282adba93]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:41 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:41 user nova-compute[70374]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c (non-flash)
Jul 27 09:32:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:41 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:41 user nova-compute[70374]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c (non-flash)
Jul 27 09:32:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdd57f4-2632-4c10-a5d4-32c931a874f5]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdaFcWLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23538393662353264', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538393662353264', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG nova.objects.instance [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'flavor' on Instance uuid 42f4c546-47e4-485b-be29-4081c7557bad {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:32:42 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:42 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:32:42 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:42 user nova-compute[70374]:   <serial>6ae2fa33-45a0-4d20-bbaf-a51427718f3c</serial>
Jul 27 09:32:42 user nova-compute[70374]: </disk>
Jul 27 09:32:42 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] No VIF found with MAC fa:16:3e:bf:c6:71, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-86ba2a64-bf01-4ca3-9b86-44c81138ae4f tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.718s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:44 user nova-compute[70374]: INFO nova.compute.manager [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Detaching volume 6ae2fa33-45a0-4d20-bbaf-a51427718f3c
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-1416af5b-28c8-4820-95ee-42b8ae36fc9b req-11009277-b2d2-4c47-8cc3-a171658aba6d service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-changed-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-1416af5b-28c8-4820-95ee-42b8ae36fc9b req-11009277-b2d2-4c47-8cc3-a171658aba6d service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Refreshing instance network info cache due to event network-changed-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1416af5b-28c8-4820-95ee-42b8ae36fc9b req-11009277-b2d2-4c47-8cc3-a171658aba6d service nova] Acquiring lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1416af5b-28c8-4820-95ee-42b8ae36fc9b req-11009277-b2d2-4c47-8cc3-a171658aba6d service nova] Acquired lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.network.neutron [req-1416af5b-28c8-4820-95ee-42b8ae36fc9b req-11009277-b2d2-4c47-8cc3-a171658aba6d service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Refreshing network info cache for port 6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:44 user nova-compute[70374]: INFO nova.virt.block_device [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Attempting to driver detach volume 6ae2fa33-45a0-4d20-bbaf-a51427718f3c from mountpoint /dev/vdb
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Attempting to detach device vdb from instance 42f4c546-47e4-485b-be29-4081c7557bad from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:32:44 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:44 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:32:44 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:44 user nova-compute[70374]:   <serial>6ae2fa33-45a0-4d20-bbaf-a51427718f3c</serial>
Jul 27 09:32:44 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:32:44 user nova-compute[70374]: </disk>
Jul 27 09:32:44 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:32:44 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Successfully detached device vdb from instance 42f4c546-47e4-485b-be29-4081c7557bad from the persistent domain config.
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42f4c546-47e4-485b-be29-4081c7557bad from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:32:44 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:44 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:32:44 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:44 user nova-compute[70374]:   <serial>6ae2fa33-45a0-4d20-bbaf-a51427718f3c</serial>
Jul 27 09:32:44 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:32:44 user nova-compute[70374]: </disk>
Jul 27 09:32:44 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450349.3373542, 25214e8a-c626-46a7-b273-eb491c2fc91b => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:32:44 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Stopped (Lifecycle Event)
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e8046713-baa3-4e76-a791-bd8d5b056ac3 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e8046713-baa3-4e76-a791-bd8d5b056ac3 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.network.neutron [req-1416af5b-28c8-4820-95ee-42b8ae36fc9b req-11009277-b2d2-4c47-8cc3-a171658aba6d service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updated VIF entry in instance network info cache for port 6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.network.neutron [req-1416af5b-28c8-4820-95ee-42b8ae36fc9b req-11009277-b2d2-4c47-8cc3-a171658aba6d service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1416af5b-28c8-4820-95ee-42b8ae36fc9b req-11009277-b2d2-4c47-8cc3-a171658aba6d service nova] Releasing lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "interface-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "interface-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'flavor' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450364.7450879, 42f4c546-47e4-485b-be29-4081c7557bad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42f4c546-47e4-485b-be29-4081c7557bad {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:32:44 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Successfully detached device vdb from instance 42f4c546-47e4-485b-be29-4081c7557bad from the live domain config.
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdaFcWLo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:44 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ce08ba-2db1-47e3-ba95-89d9cd0fc9fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:32:44 user nova-compute[70374]: No targets found.
Jul 27 09:32:44 user nova-compute[70374]: iSNS:
Jul 27 09:32:44 user nova-compute[70374]: No targets found.
Jul 27 09:32:44 user nova-compute[70374]: STATIC:
Jul 27 09:32:44 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:32:44 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:44 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:44 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:32:44 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:44 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:44 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c
Jul 27 09:32:44 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:44 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:44 user nova-compute[70374]: FIRMWARE:
Jul 27 09:32:44 user nova-compute[70374]: No targets found.
Jul 27 09:32:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:32:44 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:32:44 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a645e966-4504-4474-bf1a-9204c489b82e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c63b7c-c625-4094-b427-2fc6d35168c2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:44 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:44 user nova-compute[70374]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c (non-flash)
Jul 27 09:32:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:44 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:44 user nova-compute[70374]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c (non-flash)
Jul 27 09:32:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc340160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2957cc04-5bd4-4e85-a3b7-218bfa521107]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c859fe4-ab68-4f63-806b-bf900dbad44a]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[41da5410-7c63-4cf1-a9b1-b7a15fbd68b5]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d356395-58c5-4bb0-843b-5f20a60a10f8]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'pci_requests' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65995dc-7e08-4d44-b460-dbfc21cc7ab1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[567e5fb9-bbff-43a4-a18e-0efb1ac3187a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c, portal: 172.16.0.220,3260]
Jul 27 09:32:45 user nova-compute[70374]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:45 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae2fa33-45a0-4d20-bbaf-a51427718f3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b9504-27b1-4e97-a2e7-b0557bdddb38]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] <== disconnect_volume: return (325ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG nova.policy [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d33f8cd041046c18af25f56b63b6bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3e52a41c1847b199e6dcd09b676fba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Successfully created port: e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:32:45 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'flavor' on Instance uuid 42f4c546-47e4-485b-be29-4081c7557bad {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d807cdab-6438-4c16-8664-0e49c4bb18c9 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:46 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:46 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:46 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d868e0-82f6-4110-87f3-96fc449109c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:32:46 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cee924-047f-4aa7-9730-12d72abcfcce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac] added
Jul 27 09:32:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be4a382-8eee-49ed-9b3b-c413a7ad83e7]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d76361-b43e-4710-ab55-d1d0c8e5ee4e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUpudWeL {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUpudWeL" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ed9a69-e166-4090-9c7c-202ec56e5127]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KUpudWeL'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515c333-a314-4c69-962c-5fbdee2f26be]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1f2ba0-7920-4f4f-839f-b2dfc00328c4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:46 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:46 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d96ce06-8405-48f6-b2aa-1df59504e9c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260]
Jul 27 09:32:46 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b32679-4142-497d-ad83-f996fc7cc2f7]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[264eae0d-009e-40a6-983d-349a759f89ab]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:46 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:46 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:46 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:46 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1377a1c6-e403-4088-8754-3518601c6c2d]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Successfully updated port: e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquired lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-27aed475-3713-4f3d-8447-1f7fbcf75e85 req-4da4ed27-c1e1-49e2-b178-7aeb99a8a2bf service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-changed-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-27aed475-3713-4f3d-8447-1f7fbcf75e85 req-4da4ed27-c1e1-49e2-b178-7aeb99a8a2bf service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Refreshing instance network info cache due to event network-changed-e86f785e-63db-4bd0-92b9-6b813174c7a5. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:32:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27aed475-3713-4f3d-8447-1f7fbcf75e85 req-4da4ed27-c1e1-49e2-b178-7aeb99a8a2bf service nova] Acquiring lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYfpjgzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:47 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Releasing lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27aed475-3713-4f3d-8447-1f7fbcf75e85 req-4da4ed27-c1e1-49e2-b178-7aeb99a8a2bf service nova] Acquired lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-27aed475-3713-4f3d-8447-1f7fbcf75e85 req-4da4ed27-c1e1-49e2-b178-7aeb99a8a2bf service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Refreshing network info cache for port e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converting VIF {"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_vif [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape86f785e-63, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape86f785e-63, col_values=(('external_ids', {'iface-id': 'e86f785e-63db-4bd0-92b9-6b813174c7a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:a9:cb', 'vm-uuid': 'b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:47 user nova-compute[70374]: INFO os_vif [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63')
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converting VIF {"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] attach device xml: <interface type="ethernet">
Jul 27 09:32:47 user nova-compute[70374]:   <mac address="fa:16:3e:f8:a9:cb"/>
Jul 27 09:32:47 user nova-compute[70374]:   <model type="virtio"/>
Jul 27 09:32:47 user nova-compute[70374]:   <mtu size="1442"/>
Jul 27 09:32:47 user nova-compute[70374]:   <target dev="tape86f785e-63"/>
Jul 27 09:32:47 user nova-compute[70374]: </interface>
Jul 27 09:32:47 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23065313130373465', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065313130373465', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.363s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:47 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:47 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lazy-loading 'flavor' on Instance uuid d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b077ae6-d439-41f8-aa66-7e6823ca80d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:32:47 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:32:47 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:47 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:32:47 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:47 user nova-compute[70374]:   <serial>25fa94b4-c6dc-4dbd-add9-e3a58523baac</serial>
Jul 27 09:32:47 user nova-compute[70374]: </disk>
Jul 27 09:32:47 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9ae4dd-5444-4830-adc1-455f3e9217db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e] added
Jul 27 09:32:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df39f22-146a-4bd5-85a8-ed86a261bac6]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[28809ec7-5eca-4160-872d-c79f00d1ff9f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYfpjgzV {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYfpjgzV" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0120463f-a106-4222-be11-5c13df567504]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NYfpjgzV'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f7f689-8551-4672-9445-16add95da657]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ba3a1-852f-4654-81dc-6a088e53d2d8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a863fbd0-9449-4ff2-92e6-40954153c5c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e, portal: 172.16.0.220,3260]
Jul 27 09:32:47 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-59e9bcab-3ac4-4b37-819e-8608fe60cff4 req-fe6c1b0b-205a-48c6-8055-0bd70b44e3b2 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-59e9bcab-3ac4-4b37-819e-8608fe60cff4 req-fe6c1b0b-205a-48c6-8055-0bd70b44e3b2 service nova] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-59e9bcab-3ac4-4b37-819e-8608fe60cff4 req-fe6c1b0b-205a-48c6-8055-0bd70b44e3b2 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-59e9bcab-3ac4-4b37-819e-8608fe60cff4 req-fe6c1b0b-205a-48c6-8055-0bd70b44e3b2 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-59e9bcab-3ac4-4b37-819e-8608fe60cff4 req-fe6c1b0b-205a-48c6-8055-0bd70b44e3b2 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] No waiting events found dispatching network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:47 user nova-compute[70374]: WARNING nova.compute.manager [req-59e9bcab-3ac4-4b37-819e-8608fe60cff4 req-fe6c1b0b-205a-48c6-8055-0bd70b44e3b2 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received unexpected event network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 for instance with vm_state active and task_state None.
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc01f1f-40e6-442c-b15b-7bd800e0f0ae]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6b8983-a647-4291-8d4f-f0adf7969a48]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e (non-flash)
Jul 27 09:32:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:47 user nova-compute[70374]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e (non-flash)
Jul 27 09:32:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-27aed475-3713-4f3d-8447-1f7fbcf75e85 req-4da4ed27-c1e1-49e2-b178-7aeb99a8a2bf service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updated VIF entry in instance network info cache for port e86f785e-63db-4bd0-92b9-6b813174c7a5. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-27aed475-3713-4f3d-8447-1f7fbcf75e85 req-4da4ed27-c1e1-49e2-b178-7aeb99a8a2bf service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No BDM found with device name hda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No VIF found with MAC fa:16:3e:b2:9d:c3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0859e7-c7c6-4b9a-ab0d-14264e151c3c]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYfpjgzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27aed475-3713-4f3d-8447-1f7fbcf75e85 req-4da4ed27-c1e1-49e2-b178-7aeb99a8a2bf service nova] Releasing lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:32:47 user nova-compute[70374]:   <nova:package version="0.0.0"/>
Jul 27 09:32:47 user nova-compute[70374]:   <nova:name>tempest-device-tagging-server-175106609</nova:name>
Jul 27 09:32:47 user nova-compute[70374]:   <nova:creationTime>2023-07-27 09:32:47</nova:creationTime>
Jul 27 09:32:47 user nova-compute[70374]:   <nova:flavor name="m1.tiny">
Jul 27 09:32:47 user nova-compute[70374]:     <nova:memory>512</nova:memory>
Jul 27 09:32:47 user nova-compute[70374]:     <nova:disk>1</nova:disk>
Jul 27 09:32:47 user nova-compute[70374]:     <nova:swap>0</nova:swap>
Jul 27 09:32:47 user nova-compute[70374]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:32:47 user nova-compute[70374]:     <nova:vcpus>1</nova:vcpus>
Jul 27 09:32:47 user nova-compute[70374]:   </nova:flavor>
Jul 27 09:32:47 user nova-compute[70374]:   <nova:owner>
Jul 27 09:32:47 user nova-compute[70374]:     <nova:user uuid="6d33f8cd041046c18af25f56b63b6bb5">tempest-TaggedAttachmentsTest-493274998-project-member</nova:user>
Jul 27 09:32:47 user nova-compute[70374]:     <nova:project uuid="df3e52a41c1847b199e6dcd09b676fba">tempest-TaggedAttachmentsTest-493274998</nova:project>
Jul 27 09:32:47 user nova-compute[70374]:   </nova:owner>
Jul 27 09:32:47 user nova-compute[70374]:   <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:32:47 user nova-compute[70374]:   <nova:ports>
Jul 27 09:32:47 user nova-compute[70374]:     <nova:port uuid="6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f">
Jul 27 09:32:47 user nova-compute[70374]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:32:47 user nova-compute[70374]:     </nova:port>
Jul 27 09:32:47 user nova-compute[70374]:     <nova:port uuid="e86f785e-63db-4bd0-92b9-6b813174c7a5">
Jul 27 09:32:47 user nova-compute[70374]:       <nova:ip type="fixed" address="10.10.10.80" ipVersion="4"/>
Jul 27 09:32:47 user nova-compute[70374]:     </nova:port>
Jul 27 09:32:47 user nova-compute[70374]:   </nova:ports>
Jul 27 09:32:47 user nova-compute[70374]: </nova:instance>
Jul 27 09:32:47 user nova-compute[70374]:  {{(pid=70374) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 09:32:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2527503c-2b26-4355-945d-94cba18792bd tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "interface-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.237s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] No VIF found with MAC fa:16:3e:2d:07:78, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d09fde6-af06-4e12-8545-49a102d0804e tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.970s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'flavor' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "773917c6-56d7-4491-a760-05f51593b7f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:48 user nova-compute[70374]: INFO nova.compute.manager [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Terminating instance
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:48 user nova-compute[70374]: INFO nova.compute.manager [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Attaching volume 1bee565c-934c-49bb-9a23-cafd79caf6c9 to /dev/vdb
Jul 27 09:32:48 user nova-compute[70374]: DEBUG os_brick.utils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9c9e3b-80b1-4d8c-b901-498783156f0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[53400302-4a49-428c-b3f6-ca5981863e57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-409e0c71-e0e8-4045-a339-756cb9f130a8 req-1e0f0b13-16f6-477f-9f49-0b1fa019438f service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-unplugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-409e0c71-e0e8-4045-a339-756cb9f130a8 req-1e0f0b13-16f6-477f-9f49-0b1fa019438f service nova] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-409e0c71-e0e8-4045-a339-756cb9f130a8 req-1e0f0b13-16f6-477f-9f49-0b1fa019438f service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-409e0c71-e0e8-4045-a339-756cb9f130a8 req-1e0f0b13-16f6-477f-9f49-0b1fa019438f service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-409e0c71-e0e8-4045-a339-756cb9f130a8 req-1e0f0b13-16f6-477f-9f49-0b1fa019438f service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] No waiting events found dispatching network-vif-unplugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-409e0c71-e0e8-4045-a339-756cb9f130a8 req-1e0f0b13-16f6-477f-9f49-0b1fa019438f service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-unplugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[706630c9-2e1a-4928-b609-066b75b1291e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] <== connect_volume: return (1765ms) {'type': 'block', 'scsi_wwn': '26161313833653666', 'path': '/dev/sde'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313833653666', 'path': '/dev/sde'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[63033fe8-b7a7-4e7e-9a21-4b56ae0e3101]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:48 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:32:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dde185-621c-4102-9136-b3100c62bb43]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG os_brick.utils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating existing volume attachment record: 99716295-d088-4bb8-bb69-cd7b54328f73 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lazy-loading 'flavor' on Instance uuid 309c9c26-4a0f-45db-bb3a-595b19f3f627 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:32:48 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:48 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:32:48 user nova-compute[70374]:   <target dev="sdc" bus="scsi"/>
Jul 27 09:32:48 user nova-compute[70374]:   <serial>0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e</serial>
Jul 27 09:32:48 user nova-compute[70374]:   <address type="drive" controller="0" unit="2"/>
Jul 27 09:32:48 user nova-compute[70374]: </disk>
Jul 27 09:32:48 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Instance destroyed successfully.
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lazy-loading 'resources' on Instance uuid 773917c6-56d7-4491-a760-05f51593b7f0 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1574025589',display_name='tempest-VolumesActionsTest-instance-1574025589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1574025589',id=10,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d88292245b8d4bbfa07efc8084ae089c',ramdisk_id='',reservation_id='r-dbzwfifo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2082395054',owner_user_name='tempest-VolumesActionsTest-2082395054-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:31:00Z,user_data=None,user_id='459cb24159604669a118a1da67fbdf72',uuid=773917c6-56d7-4491-a760-05f51593b7f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Converting VIF {"id": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "address": "fa:16:3e:19:0c:8d", "network": {"id": "efa0e322-091b-4b62-b5f9-8a09fa192696", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681513154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d88292245b8d4bbfa07efc8084ae089c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8fbf870-e2", "ovs_interfaceid": "c8fbf870-e2d7-4ec6-be17-98f3d9315f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0c:8d,bridge_name='br-int',has_traffic_filtering=True,id=c8fbf870-e2d7-4ec6-be17-98f3d9315f75,network=Network(efa0e322-091b-4b62-b5f9-8a09fa192696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fbf870-e2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG os_vif [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0c:8d,bridge_name='br-int',has_traffic_filtering=True,id=c8fbf870-e2d7-4ec6-be17-98f3d9315f75,network=Network(efa0e322-091b-4b62-b5f9-8a09fa192696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fbf870-e2') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8fbf870-e2, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: INFO os_vif [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0c:8d,bridge_name='br-int',has_traffic_filtering=True,id=c8fbf870-e2d7-4ec6-be17-98f3d9315f75,network=Network(efa0e322-091b-4b62-b5f9-8a09fa192696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8fbf870-e2')
Jul 27 09:32:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Deleting instance files /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0_del
Jul 27 09:32:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Deletion of /opt/stack/data/nova/instances/773917c6-56d7-4491-a760-05f51593b7f0_del complete
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] No BDM found with device name sda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] No VIF found with MAC fa:16:3e:57:6c:c6, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:49 user nova-compute[70374]: INFO nova.compute.manager [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 27 09:32:49 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-8dd09c00-738c-4b38-af18-5fa8f0a793a0 req-1251ce73-c4a5-4ac4-9670-385412adb42a service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8dd09c00-738c-4b38-af18-5fa8f0a793a0 req-1251ce73-c4a5-4ac4-9670-385412adb42a service nova] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8dd09c00-738c-4b38-af18-5fa8f0a793a0 req-1251ce73-c4a5-4ac4-9670-385412adb42a service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8dd09c00-738c-4b38-af18-5fa8f0a793a0 req-1251ce73-c4a5-4ac4-9670-385412adb42a service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-8dd09c00-738c-4b38-af18-5fa8f0a793a0 req-1251ce73-c4a5-4ac4-9670-385412adb42a service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] No waiting events found dispatching network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:49 user nova-compute[70374]: WARNING nova.compute.manager [req-8dd09c00-738c-4b38-af18-5fa8f0a793a0 req-1251ce73-c4a5-4ac4-9670-385412adb42a service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received unexpected event network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 for instance with vm_state active and task_state None.
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-db80aa10-c0ae-4202-99c3-a07c936df96c tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.518s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG os_brick.utils [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[adec6ea5-61d6-48f7-bbbc-e061d8d285f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc77c665-0422-4f62-9c26-c94b2d68167d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9834f-a4bf-43ff-83db-a21b9bd5dfd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd1b524-cb22-4902-9fff-36f6f5b7bc3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:32:50 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a587e9dc-3181-4eb0-bfc2-8f2f4369e23e]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG os_brick.utils [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:50 user nova-compute[70374]: INFO nova.compute.manager [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Swapping volume 25fa94b4-c6dc-4dbd-add9-e3a58523baac for 4f6a5d8f-095f-487e-b752-c9b1ce301b09
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:32:50 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Took 0.67 seconds to deallocate network for instance.
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-01e60465-c843-412b-ad29-30e41157447a req-32aba15b-3105-4746-a4f5-dc0fcc557c17 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-deleted-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] No waiting events found dispatching network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:50 user nova-compute[70374]: WARNING nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received unexpected event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 for instance with vm_state deleted and task_state None.
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] No waiting events found dispatching network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:50 user nova-compute[70374]: WARNING nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received unexpected event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 for instance with vm_state deleted and task_state None.
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] No waiting events found dispatching network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:50 user nova-compute[70374]: WARNING nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received unexpected event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 for instance with vm_state deleted and task_state None.
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-unplugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] No waiting events found dispatching network-vif-unplugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:50 user nova-compute[70374]: WARNING nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received unexpected event network-vif-unplugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 for instance with vm_state deleted and task_state None.
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Acquiring lock "773917c6-56d7-4491-a760-05f51593b7f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] Lock "773917c6-56d7-4491-a760-05f51593b7f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] No waiting events found dispatching network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:50 user nova-compute[70374]: WARNING nova.compute.manager [req-ddee4fb7-55a7-4609-968a-be73d8243058 req-1c6802d1-dc83-4faf-8e74-90d5b71fe4f3 service nova] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Received unexpected event network-vif-plugged-c8fbf870-e2d7-4ec6-be17-98f3d9315f75 for instance with vm_state deleted and task_state None.
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:50 user nova-compute[70374]: INFO nova.compute.manager [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Detaching volume 0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e
Jul 27 09:32:51 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Deleted allocations for instance 773917c6-56d7-4491-a760-05f51593b7f0
Jul 27 09:32:51 user nova-compute[70374]: INFO nova.virt.block_device [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Attempting to driver detach volume 0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e from mountpoint /dev/sdc
Jul 27 09:32:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Attempting to detach device sdc from instance 309c9c26-4a0f-45db-bb3a-595b19f3f627 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:32:51 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:51 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:32:51 user nova-compute[70374]:   <target dev="sdc" bus="scsi"/>
Jul 27 09:32:51 user nova-compute[70374]:   <serial>0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e</serial>
Jul 27 09:32:51 user nova-compute[70374]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 09:32:51 user nova-compute[70374]: </disk>
Jul 27 09:32:51 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:32:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Successfully detached device sdc from instance 309c9c26-4a0f-45db-bb3a-595b19f3f627 from the persistent domain config.
Jul 27 09:32:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 309c9c26-4a0f-45db-bb3a-595b19f3f627 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:32:51 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:51 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:32:51 user nova-compute[70374]:   <target dev="sdc" bus="scsi"/>
Jul 27 09:32:51 user nova-compute[70374]:   <serial>0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e</serial>
Jul 27 09:32:51 user nova-compute[70374]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 09:32:51 user nova-compute[70374]: </disk>
Jul 27 09:32:51 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c84-3fe0-421a-85d8-b1de42d96d9a tempest-VolumesActionsTest-2082395054 tempest-VolumesActionsTest-2082395054-project-member] Lock "773917c6-56d7-4491-a760-05f51593b7f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.714s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450371.4902196, 309c9c26-4a0f-45db-bb3a-595b19f3f627 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 309c9c26-4a0f-45db-bb3a-595b19f3f627 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:32:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Successfully detached device sdc from instance 309c9c26-4a0f-45db-bb3a-595b19f3f627 from the live domain config.
Jul 27 09:32:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYfpjgzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:51 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce92dd-1820-483d-bc59-cbef9bb070ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:32:51 user nova-compute[70374]: No targets found.
Jul 27 09:32:51 user nova-compute[70374]: iSNS:
Jul 27 09:32:51 user nova-compute[70374]: No targets found.
Jul 27 09:32:51 user nova-compute[70374]: STATIC:
Jul 27 09:32:51 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:32:51 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:51 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:51 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e
Jul 27 09:32:51 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:51 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:51 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:32:51 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:51 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:51 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac
Jul 27 09:32:51 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:32:51 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:32:51 user nova-compute[70374]: FIRMWARE:
Jul 27 09:32:51 user nova-compute[70374]: No targets found.
Jul 27 09:32:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:32:51 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:32:51 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bf901d-13cf-497a-975b-f2ff13ecd5c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[70277205-62f6-43fb-b0f3-a2bb07d6fdd9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:51 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:51 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:51 user nova-compute[70374]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e (non-flash)
Jul 27 09:32:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:51 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:51 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:51 user nova-compute[70374]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e (non-flash)
Jul 27 09:32:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280b7c4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e'): ({'sde'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Removing single pathed devices sde {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b9b011-c93b-4465-b5e5-51e4a17fe24a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3849a7-e892-460d-80c5-7ce3b407266a]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Flushing IO for device /dev/sde {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4160c1-0948-4b1e-bc26-9aa6a56ab6aa]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f26a147-4047-4ee0-a72c-af1ba4283739]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3accd9a1-8040-4f9f-b590-52cbba8f1d8d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff1cc4-91dc-43e4-b8f1-2c586e0e4195]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e, portal: 172.16.0.220,3260]
Jul 27 09:32:51 user nova-compute[70374]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec6fb44-65f2-48c6-9c3b-900d51d5dc0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[de295849-2b00-4325-b890-8d9883df4f00]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] <== disconnect_volume: return (311ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:32:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rAiDNkvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:56 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:56 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:56 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b226cc-afdc-4892-b13e-50bf7c297310]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:32:56 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9877d1fa-34c7-4671-97eb-35cbc95f66bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9] added
Jul 27 09:32:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[955fc122-67e9-422d-a80f-934f6746622e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf7af0-7d2c-49a2-837f-23cf03ecc2b2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rAiDNkvz {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rAiDNkvz" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6fc131-066b-4fde-a085-b55d89fce261]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rAiDNkvz'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[080db09f-e4cf-4016-a761-a5c3367275ce]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50920b6-911a-4ef4-9371-a80e0ed0350a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b51b80e-6e3c-4db2-a8a1-f0a599ce03bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9, portal: 172.16.0.220,3260]
Jul 27 09:32:56 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8408be6-60ac-4312-a789-a88ce2cc09a7]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad58e7a-4d61-45e6-bf57-d9b87e88d452]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:56 user nova-compute[70374]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)
Jul 27 09:32:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[755f2c25-2e74-420f-90f4-fe5ec59fff2e]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rAiDNkvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23831346331333234', 'path': '/dev/sde'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831346331333234', 'path': '/dev/sde'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'flavor' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:32:57 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:57 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:32:57 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:57 user nova-compute[70374]:   <serial>1bee565c-934c-49bb-9a23-cafd79caf6c9</serial>
Jul 27 09:32:57 user nova-compute[70374]: </disk>
Jul 27 09:32:57 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.objects.instance [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lazy-loading 'flavor' on Instance uuid 309c9c26-4a0f-45db-bb3a-595b19f3f627 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f0d0dbe6-77e0-4072-b67b-27bb8a0bcf99 tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.713s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No BDM found with device name hda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] No VIF found with MAC fa:16:3e:b2:9d:c3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhDngcBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35fe056-8279-479a-a673-6c61e5ec6933', 'attached_at': '', 'detached_at': '', 'volume_id': '4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'serial': '4f6a5d8f-095f-487e-b752-c9b1ce301b09'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd35fe056-8279-479a-a673-6c61e5ec6933', 'attached_at': '', 'detached_at': '', 'volume_id': '25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'serial'} {{(pid=70374) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhDngcBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:32:57 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:57 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:32:57 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b71c310-a827-4c9b-ae77-92337fbadbfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:32:57 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7674f8f2-0c44-4a96-97e0-94ca1e70b230]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09] added
Jul 27 09:32:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[426c9b63-642f-439c-bc73-13636a26d129]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ea38ab-747f-440e-a444-c0c0965a780d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhDngcBP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9377f114-9a4e-470e-9e9f-9a7b689b241d tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.190s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhDngcBP" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdadc357-b23c-44cd-a731-b9525d2b591f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MhDngcBP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4706874-d952-4e7a-bda5-e9717dc17754]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bbca06-14e1-4ed9-a093-1984f3797a54]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:57 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:57 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:57 user nova-compute[70374]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)
Jul 27 09:32:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:57 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:57 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:57 user nova-compute[70374]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)
Jul 27 09:32:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8377182-32f9-485a-a4cc-3d28d55fd23e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09, portal: 172.16.0.220,3260]
Jul 27 09:32:58 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09, portal: 172.16.0.220,3260] successful.
Jul 27 09:32:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a325896f-2c60-4785-82fd-fa082aa739ac]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb121a27-abe1-4a30-b3a4-bdbe5b50b71e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:58 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:58 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:58 user nova-compute[70374]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)
Jul 27 09:32:58 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:32:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:32:58 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:32:58 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:32:58 user nova-compute[70374]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)
Jul 27 09:32:58 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:32:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0d0464-8dae-44f9-9e8e-818c62f2a42d]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhDngcBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:58 user nova-compute[70374]: INFO nova.compute.manager [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Terminating instance
Jul 27 09:32:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-65b4a896-1f60-4151-a343-c6d76ed56db0 req-efc0e918-a52d-4d6e-abf4-874007a81809 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received event network-vif-unplugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-65b4a896-1f60-4151-a343-c6d76ed56db0 req-efc0e918-a52d-4d6e-abf4-874007a81809 service nova] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-65b4a896-1f60-4151-a343-c6d76ed56db0 req-efc0e918-a52d-4d6e-abf4-874007a81809 service nova] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-65b4a896-1f60-4151-a343-c6d76ed56db0 req-efc0e918-a52d-4d6e-abf4-874007a81809 service nova] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-65b4a896-1f60-4151-a343-c6d76ed56db0 req-efc0e918-a52d-4d6e-abf4-874007a81809 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] No waiting events found dispatching network-vif-unplugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:32:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-65b4a896-1f60-4151-a343-c6d76ed56db0 req-efc0e918-a52d-4d6e-abf4-874007a81809 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received event network-vif-unplugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:32:58 user nova-compute[70374]: INFO nova.compute.manager [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Detaching volume 1bee565c-934c-49bb-9a23-cafd79caf6c9
Jul 27 09:32:59 user nova-compute[70374]: INFO nova.virt.block_device [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Attempting to driver detach volume 1bee565c-934c-49bb-9a23-cafd79caf6c9 from mountpoint /dev/vdb
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Attempting to detach device vdb from instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:32:59 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:59 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:32:59 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:59 user nova-compute[70374]:   <serial>1bee565c-934c-49bb-9a23-cafd79caf6c9</serial>
Jul 27 09:32:59 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 09:32:59 user nova-compute[70374]: </disk>
Jul 27 09:32:59 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:32:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Successfully detached device vdb from instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 from the persistent domain config.
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:32:59 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:32:59 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:32:59 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:32:59 user nova-compute[70374]:   <serial>1bee565c-934c-49bb-9a23-cafd79caf6c9</serial>
Jul 27 09:32:59 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 09:32:59 user nova-compute[70374]: </disk>
Jul 27 09:32:59 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23539623031313534', 'path': '/dev/sdf'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539623031313534', 'path': '/dev/sdf'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.objects.instance [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lazy-loading 'flavor' on Instance uuid d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Instance destroyed successfully.
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.objects.instance [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lazy-loading 'resources' on Instance uuid 309c9c26-4a0f-45db-bb3a-595b19f3f627 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-860974169',display_name='tempest-AttachSCSIVolumeTestJSON-server-860974169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-860974169',id=8,image_ref='726e1210-3ce3-486f-9417-95adaf9ac235',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2UxiY9xja9j2e+bYNFRInNFJS7DjB/7i9A7rll9a0HowWQT/92Qp4K1SO60+YclaZAVgDJD7MloBXQCsn+BhUVizXOve/ao95EzmtZUBSUTgLTVXF8O7s8qW7tjuxGXQ==',key_name='tempest-keypair-936823846',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdd638e5400740279443a374e3e570d4',ramdisk_id='',reservation_id='r-010r1p2b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='726e1210-3ce3-486f-9417-95adaf9ac235',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-284147988',owner_user_name='tempest-AttachSCSIVolumeTestJSON-284147988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='103aa251c26c4987814bc5973d86e601',uuid=309c9c26-4a0f-45db-bb3a-595b19f3f627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Converting VIF {"id": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "address": "fa:16:3e:57:6c:c6", "network": {"id": "f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2084493807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd638e5400740279443a374e3e570d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626b287e-22", "ovs_interfaceid": "626b287e-22ee-49d7-8ec3-c1a0660bd5d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:6c:c6,bridge_name='br-int',has_traffic_filtering=True,id=626b287e-22ee-49d7-8ec3-c1a0660bd5d8,network=Network(f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626b287e-22') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG os_vif [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:6c:c6,bridge_name='br-int',has_traffic_filtering=True,id=626b287e-22ee-49d7-8ec3-c1a0660bd5d8,network=Network(f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626b287e-22') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap626b287e-22, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:32:59 user nova-compute[70374]: INFO os_vif [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:6c:c6,bridge_name='br-int',has_traffic_filtering=True,id=626b287e-22ee-49d7-8ec3-c1a0660bd5d8,network=Network(f6f1459d-22db-4bf7-8b7b-d6dec4fa18d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626b287e-22')
Jul 27 09:32:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Deleting instance files /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627_del
Jul 27 09:32:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Deletion of /opt/stack/data/nova/instances/309c9c26-4a0f-45db-bb3a-595b19f3f627_del complete
Jul 27 09:32:59 user nova-compute[70374]: INFO nova.compute.manager [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 27 09:32:59 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:32:59 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450380.0133202, b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:33:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Successfully detached device vdb from instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 from the live domain config.
Jul 27 09:33:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rAiDNkvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[030aa6bb-a9a5-4d85-9012-2412e3e31162]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:33:00 user nova-compute[70374]: No targets found.
Jul 27 09:33:00 user nova-compute[70374]: iSNS:
Jul 27 09:33:00 user nova-compute[70374]: No targets found.
Jul 27 09:33:00 user nova-compute[70374]: STATIC:
Jul 27 09:33:00 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9
Jul 27 09:33:00 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:00 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:00 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09
Jul 27 09:33:00 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:00 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:00 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:33:00 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:00 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:00 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:33:00 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:00 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:00 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac
Jul 27 09:33:00 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:00 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:00 user nova-compute[70374]: FIRMWARE:
Jul 27 09:33:00 user nova-compute[70374]: No targets found.
Jul 27 09:33:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:33:00 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:33:00 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[535378f2-1a09-4399-9b26-4369c8b37ee7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ea5d76-a2cd-46c2-b21f-7598e555e9c2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:00 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:00 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:00 user nova-compute[70374]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)
Jul 27 09:33:00 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:00 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:00 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:00 user nova-compute[70374]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 (non-flash)
Jul 27 09:33:00 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc2dcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9'): ({'sde'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Removing single pathed devices sde {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8440377c-3451-4134-9fcd-f11fbf68816e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb501a9-2534-4610-90e1-7f055c1fb464]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Flushing IO for device /dev/sde {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 183500800 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2498e112-f1ce-4144-995d-f2bbc9f0cf54]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5ccfa0-6165-402a-9c54-faed4c454104]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c4dc8a-2bcc-407d-b506-a344824f2aed]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0706cc1a-f899-452a-90b5-90ad54b9dcd1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9, portal: 172.16.0.220,3260]
Jul 27 09:33:00 user nova-compute[70374]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9, portal: 172.16.0.220,3260] successful.
Jul 27 09:33:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee565c-934c-49bb-9a23-cafd79caf6c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9533e0-ef80-415f-a485-d42540b08242]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] <== disconnect_volume: return (441ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:33:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 359661568 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-a57ff960-4e93-4765-a7b3-58b6f787341a req-4cfdee70-4f40-4a19-a161-6023f1a8a0cf service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received event network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a57ff960-4e93-4765-a7b3-58b6f787341a req-4cfdee70-4f40-4a19-a161-6023f1a8a0cf service nova] Acquiring lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a57ff960-4e93-4765-a7b3-58b6f787341a req-4cfdee70-4f40-4a19-a161-6023f1a8a0cf service nova] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a57ff960-4e93-4765-a7b3-58b6f787341a req-4cfdee70-4f40-4a19-a161-6023f1a8a0cf service nova] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-a57ff960-4e93-4765-a7b3-58b6f787341a req-4cfdee70-4f40-4a19-a161-6023f1a8a0cf service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] No waiting events found dispatching network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:01 user nova-compute[70374]: WARNING nova.compute.manager [req-a57ff960-4e93-4765-a7b3-58b6f787341a req-4cfdee70-4f40-4a19-a161-6023f1a8a0cf service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received unexpected event network-vif-plugged-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 for instance with vm_state active and task_state deleting.
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 485490688 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:01 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Took 1.60 seconds to deallocate network for instance.
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-81ce5401-5646-464e-94d1-8fbedbd9fc36 req-30dbed91-3693-49fc-86c3-52c8693cfe04 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Received event network-vif-deleted-626b287e-22ee-49d7-8ec3-c1a0660bd5d8 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:01 user nova-compute[70374]: INFO nova.compute.manager [req-81ce5401-5646-464e-94d1-8fbedbd9fc36 req-30dbed91-3693-49fc-86c3-52c8693cfe04 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Neutron deleted interface 626b287e-22ee-49d7-8ec3-c1a0660bd5d8; detaching it from the instance and deleting it from the info cache
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.network.neutron [req-81ce5401-5646-464e-94d1-8fbedbd9fc36 req-30dbed91-3693-49fc-86c3-52c8693cfe04 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-81ce5401-5646-464e-94d1-8fbedbd9fc36 req-30dbed91-3693-49fc-86c3-52c8693cfe04 service nova] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Detach interface failed, port_id=626b287e-22ee-49d7-8ec3-c1a0660bd5d8, reason: Instance 309c9c26-4a0f-45db-bb3a-595b19f3f627 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'flavor' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a3dcb71-5936-424f-ac97-2fef09603f73 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.690s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 646971392 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:02 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Deleted allocations for instance 309c9c26-4a0f-45db-bb3a-595b19f3f627
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 839909376 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72d6585d-6a93-4031-938e-d00cbeffa4da tempest-AttachSCSIVolumeTestJSON-284147988 tempest-AttachSCSIVolumeTestJSON-284147988-project-member] Lock "309c9c26-4a0f-45db-bb3a-595b19f3f627" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.679s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "interface-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-e86f785e-63db-4bd0-92b9-6b813174c7a5" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "interface-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-e86f785e-63db-4bd0-92b9-6b813174c7a5" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.objects.instance [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'flavor' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converting VIF {"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface> {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface> {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Attempting to detach device tape86f785e-63 from instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] detach device xml: <interface type="ethernet">
Jul 27 09:33:02 user nova-compute[70374]:   <mac address="fa:16:3e:f8:a9:cb"/>
Jul 27 09:33:02 user nova-compute[70374]:   <model type="virtio"/>
Jul 27 09:33:02 user nova-compute[70374]:   <mtu size="1442"/>
Jul 27 09:33:02 user nova-compute[70374]:   <target dev="tape86f785e-63"/>
Jul 27 09:33:02 user nova-compute[70374]: </interface>
Jul 27 09:33:02 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface> {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface>not found in domain: <domain type='kvm' id='11'>
Jul 27 09:33:02 user nova-compute[70374]:   <name>instance-0000000b</name>
Jul 27 09:33:02 user nova-compute[70374]:   <uuid>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</uuid>
Jul 27 09:33:02 user nova-compute[70374]:   <metadata>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:33:02 user nova-compute[70374]:   <nova:package version="0.0.0"/>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:name>tempest-device-tagging-server-175106609</nova:name>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:creationTime>2023-07-27 09:32:47</nova:creationTime>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:flavor name="m1.tiny">
Jul 27 09:33:02 user nova-compute[70374]:     <nova:memory>512</nova:memory>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:disk>1</nova:disk>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:swap>0</nova:swap>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:vcpus>1</nova:vcpus>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:flavor>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:owner>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:user uuid="6d33f8cd041046c18af25f56b63b6bb5">tempest-TaggedAttachmentsTest-493274998-project-member</nova:user>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:project uuid="df3e52a41c1847b199e6dcd09b676fba">tempest-TaggedAttachmentsTest-493274998</nova:project>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:owner>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:ports>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:port uuid="6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f">
Jul 27 09:33:02 user nova-compute[70374]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:33:02 user nova-compute[70374]:     </nova:port>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:port uuid="e86f785e-63db-4bd0-92b9-6b813174c7a5">
Jul 27 09:33:02 user nova-compute[70374]:       <nova:ip type="fixed" address="10.10.10.80" ipVersion="4"/>
Jul 27 09:33:02 user nova-compute[70374]:     </nova:port>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:ports>
Jul 27 09:33:02 user nova-compute[70374]: </nova:instance>
Jul 27 09:33:02 user nova-compute[70374]:   </metadata>
Jul 27 09:33:02 user nova-compute[70374]:   <memory unit='KiB'>524288</memory>
Jul 27 09:33:02 user nova-compute[70374]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 09:33:02 user nova-compute[70374]:   <vcpu placement='static'>1</vcpu>
Jul 27 09:33:02 user nova-compute[70374]:   <resource>
Jul 27 09:33:02 user nova-compute[70374]:     <partition>/machine</partition>
Jul 27 09:33:02 user nova-compute[70374]:   </resource>
Jul 27 09:33:02 user nova-compute[70374]:   <sysinfo type='smbios'>
Jul 27 09:33:02 user nova-compute[70374]:     <system>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='version'>0.0.0</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='serial'>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='uuid'>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='family'>Virtual Machine</entry>
Jul 27 09:33:02 user nova-compute[70374]:     </system>
Jul 27 09:33:02 user nova-compute[70374]:   </sysinfo>
Jul 27 09:33:02 user nova-compute[70374]:   <os>
Jul 27 09:33:02 user nova-compute[70374]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 09:33:02 user nova-compute[70374]:     <boot dev='hd'/>
Jul 27 09:33:02 user nova-compute[70374]:     <smbios mode='sysinfo'/>
Jul 27 09:33:02 user nova-compute[70374]:   </os>
Jul 27 09:33:02 user nova-compute[70374]:   <features>
Jul 27 09:33:02 user nova-compute[70374]:     <acpi/>
Jul 27 09:33:02 user nova-compute[70374]:     <apic/>
Jul 27 09:33:02 user nova-compute[70374]:     <vmcoreinfo state='on'/>
Jul 27 09:33:02 user nova-compute[70374]:   </features>
Jul 27 09:33:02 user nova-compute[70374]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 09:33:02 user nova-compute[70374]:     <model fallback='forbid'>Nehalem</model>
Jul 27 09:33:02 user nova-compute[70374]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 09:33:02 user nova-compute[70374]:     <feature policy='require' name='vme'/>
Jul 27 09:33:02 user nova-compute[70374]:     <feature policy='require' name='x2apic'/>
Jul 27 09:33:02 user nova-compute[70374]:     <feature policy='require' name='hypervisor'/>
Jul 27 09:33:02 user nova-compute[70374]:   </cpu>
Jul 27 09:33:02 user nova-compute[70374]:   <clock offset='utc'>
Jul 27 09:33:02 user nova-compute[70374]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 09:33:02 user nova-compute[70374]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 09:33:02 user nova-compute[70374]:     <timer name='hpet' present='no'/>
Jul 27 09:33:02 user nova-compute[70374]:   </clock>
Jul 27 09:33:02 user nova-compute[70374]:   <on_poweroff>destroy</on_poweroff>
Jul 27 09:33:02 user nova-compute[70374]:   <on_reboot>restart</on_reboot>
Jul 27 09:33:02 user nova-compute[70374]:   <on_crash>destroy</on_crash>
Jul 27 09:33:02 user nova-compute[70374]:   <devices>
Jul 27 09:33:02 user nova-compute[70374]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 09:33:02 user nova-compute[70374]:     <disk type='file' device='disk'>
Jul 27 09:33:02 user nova-compute[70374]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 09:33:02 user nova-compute[70374]:       <source file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk' index='2'/>
Jul 27 09:33:02 user nova-compute[70374]:       <backingStore type='file' index='3'>
Jul 27 09:33:02 user nova-compute[70374]:         <format type='raw'/>
Jul 27 09:33:02 user nova-compute[70374]:         <source file='/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1'/>
Jul 27 09:33:02 user nova-compute[70374]:         <backingStore/>
Jul 27 09:33:02 user nova-compute[70374]:       </backingStore>
Jul 27 09:33:02 user nova-compute[70374]:       <target dev='vda' bus='virtio'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='virtio-disk0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </disk>
Jul 27 09:33:02 user nova-compute[70374]:     <disk type='file' device='cdrom'>
Jul 27 09:33:02 user nova-compute[70374]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 09:33:02 user nova-compute[70374]:       <source file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.config' index='1'/>
Jul 27 09:33:02 user nova-compute[70374]:       <backingStore/>
Jul 27 09:33:02 user nova-compute[70374]:       <target dev='hda' bus='ide'/>
Jul 27 09:33:02 user nova-compute[70374]:       <readonly/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='ide0-0-0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </disk>
Jul 27 09:33:02 user nova-compute[70374]:     <controller type='usb' index='0' model='none'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='usb'/>
Jul 27 09:33:02 user nova-compute[70374]:     </controller>
Jul 27 09:33:02 user nova-compute[70374]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='pci.0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </controller>
Jul 27 09:33:02 user nova-compute[70374]:     <controller type='ide' index='0'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='ide'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 09:33:02 user nova-compute[70374]:     </controller>
Jul 27 09:33:02 user nova-compute[70374]:     <interface type='ethernet'>
Jul 27 09:33:02 user nova-compute[70374]:       <mac address='fa:16:3e:b2:9d:c3'/>
Jul 27 09:33:02 user nova-compute[70374]:       <target dev='tap6bd9ecfd-f7'/>
Jul 27 09:33:02 user nova-compute[70374]:       <model type='virtio'/>
Jul 27 09:33:02 user nova-compute[70374]:       <mtu size='1442'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='net0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </interface>
Jul 27 09:33:02 user nova-compute[70374]:     <interface type='ethernet'>
Jul 27 09:33:02 user nova-compute[70374]:       <mac address='fa:16:3e:f8:a9:cb'/>
Jul 27 09:33:02 user nova-compute[70374]:       <target dev='tape86f785e-63'/>
Jul 27 09:33:02 user nova-compute[70374]:       <model type='virtio'/>
Jul 27 09:33:02 user nova-compute[70374]:       <mtu size='1442'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='net1'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </interface>
Jul 27 09:33:02 user nova-compute[70374]:     <serial type='pty'>
Jul 27 09:33:02 user nova-compute[70374]:       <source path='/dev/pts/10'/>
Jul 27 09:33:02 user nova-compute[70374]:       <log file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log' append='off'/>
Jul 27 09:33:02 user nova-compute[70374]:       <target type='isa-serial' port='0'>
Jul 27 09:33:02 user nova-compute[70374]:         <model name='isa-serial'/>
Jul 27 09:33:02 user nova-compute[70374]:       </target>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='serial0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </serial>
Jul 27 09:33:02 user nova-compute[70374]:     <console type='pty' tty='/dev/pts/10'>
Jul 27 09:33:02 user nova-compute[70374]:       <source path='/dev/pts/10'/>
Jul 27 09:33:02 user nova-compute[70374]:       <log file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log' append='off'/>
Jul 27 09:33:02 user nova-compute[70374]:       <target type='serial' port='0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='serial0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </console>
Jul 27 09:33:02 user nova-compute[70374]:     <input type='mouse' bus='ps2'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='input0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </input>
Jul 27 09:33:02 user nova-compute[70374]:     <input type='keyboard' bus='ps2'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='input1'/>
Jul 27 09:33:02 user nova-compute[70374]:     </input>
Jul 27 09:33:02 user nova-compute[70374]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Jul 27 09:33:02 user nova-compute[70374]:       <listen type='address' address='0.0.0.0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </graphics>
Jul 27 09:33:02 user nova-compute[70374]:     <audio id='1' type='none'/>
Jul 27 09:33:02 user nova-compute[70374]:     <video>
Jul 27 09:33:02 user nova-compute[70374]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='video0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </video>
Jul 27 09:33:02 user nova-compute[70374]:     <memballoon model='virtio'>
Jul 27 09:33:02 user nova-compute[70374]:       <stats period='10'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='balloon0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </memballoon>
Jul 27 09:33:02 user nova-compute[70374]:     <rng model='virtio'>
Jul 27 09:33:02 user nova-compute[70374]:       <backend model='random'>/dev/urandom</backend>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='rng0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </rng>
Jul 27 09:33:02 user nova-compute[70374]:   </devices>
Jul 27 09:33:02 user nova-compute[70374]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 09:33:02 user nova-compute[70374]:     <label>libvirt-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</label>
Jul 27 09:33:02 user nova-compute[70374]:     <imagelabel>libvirt-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</imagelabel>
Jul 27 09:33:02 user nova-compute[70374]:   </seclabel>
Jul 27 09:33:02 user nova-compute[70374]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 09:33:02 user nova-compute[70374]:     <label>+64055:+108</label>
Jul 27 09:33:02 user nova-compute[70374]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 09:33:02 user nova-compute[70374]:   </seclabel>
Jul 27 09:33:02 user nova-compute[70374]: </domain>
Jul 27 09:33:02 user nova-compute[70374]:  {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 09:33:02 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Successfully detached device tape86f785e-63 from instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 from the persistent domain config.
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] (1/8): Attempting to detach device tape86f785e-63 with device alias net1 from instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] detach device xml: <interface type="ethernet">
Jul 27 09:33:02 user nova-compute[70374]:   <mac address="fa:16:3e:f8:a9:cb"/>
Jul 27 09:33:02 user nova-compute[70374]:   <model type="virtio"/>
Jul 27 09:33:02 user nova-compute[70374]:   <mtu size="1442"/>
Jul 27 09:33:02 user nova-compute[70374]:   <target dev="tape86f785e-63"/>
Jul 27 09:33:02 user nova-compute[70374]: </interface>
Jul 27 09:33:02 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 1015021568 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450382.8260946, b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Start waiting for the detach event from libvirt for device tape86f785e-63 with device alias net1 for instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface> {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface>not found in domain: <domain type='kvm' id='11'>
Jul 27 09:33:02 user nova-compute[70374]:   <name>instance-0000000b</name>
Jul 27 09:33:02 user nova-compute[70374]:   <uuid>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</uuid>
Jul 27 09:33:02 user nova-compute[70374]:   <metadata>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:33:02 user nova-compute[70374]:   <nova:package version="0.0.0"/>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:name>tempest-device-tagging-server-175106609</nova:name>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:creationTime>2023-07-27 09:32:47</nova:creationTime>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:flavor name="m1.tiny">
Jul 27 09:33:02 user nova-compute[70374]:     <nova:memory>512</nova:memory>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:disk>1</nova:disk>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:swap>0</nova:swap>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:vcpus>1</nova:vcpus>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:flavor>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:owner>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:user uuid="6d33f8cd041046c18af25f56b63b6bb5">tempest-TaggedAttachmentsTest-493274998-project-member</nova:user>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:project uuid="df3e52a41c1847b199e6dcd09b676fba">tempest-TaggedAttachmentsTest-493274998</nova:project>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:owner>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:ports>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:port uuid="6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f">
Jul 27 09:33:02 user nova-compute[70374]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:33:02 user nova-compute[70374]:     </nova:port>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:port uuid="e86f785e-63db-4bd0-92b9-6b813174c7a5">
Jul 27 09:33:02 user nova-compute[70374]:       <nova:ip type="fixed" address="10.10.10.80" ipVersion="4"/>
Jul 27 09:33:02 user nova-compute[70374]:     </nova:port>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:ports>
Jul 27 09:33:02 user nova-compute[70374]: </nova:instance>
Jul 27 09:33:02 user nova-compute[70374]:   </metadata>
Jul 27 09:33:02 user nova-compute[70374]:   <memory unit='KiB'>524288</memory>
Jul 27 09:33:02 user nova-compute[70374]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 09:33:02 user nova-compute[70374]:   <vcpu placement='static'>1</vcpu>
Jul 27 09:33:02 user nova-compute[70374]:   <resource>
Jul 27 09:33:02 user nova-compute[70374]:     <partition>/machine</partition>
Jul 27 09:33:02 user nova-compute[70374]:   </resource>
Jul 27 09:33:02 user nova-compute[70374]:   <sysinfo type='smbios'>
Jul 27 09:33:02 user nova-compute[70374]:     <system>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='version'>0.0.0</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='serial'>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='uuid'>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:33:02 user nova-compute[70374]:       <entry name='family'>Virtual Machine</entry>
Jul 27 09:33:02 user nova-compute[70374]:     </system>
Jul 27 09:33:02 user nova-compute[70374]:   </sysinfo>
Jul 27 09:33:02 user nova-compute[70374]:   <os>
Jul 27 09:33:02 user nova-compute[70374]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 09:33:02 user nova-compute[70374]:     <boot dev='hd'/>
Jul 27 09:33:02 user nova-compute[70374]:     <smbios mode='sysinfo'/>
Jul 27 09:33:02 user nova-compute[70374]:   </os>
Jul 27 09:33:02 user nova-compute[70374]:   <features>
Jul 27 09:33:02 user nova-compute[70374]:     <acpi/>
Jul 27 09:33:02 user nova-compute[70374]:     <apic/>
Jul 27 09:33:02 user nova-compute[70374]:     <vmcoreinfo state='on'/>
Jul 27 09:33:02 user nova-compute[70374]:   </features>
Jul 27 09:33:02 user nova-compute[70374]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 09:33:02 user nova-compute[70374]:     <model fallback='forbid'>Nehalem</model>
Jul 27 09:33:02 user nova-compute[70374]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 09:33:02 user nova-compute[70374]:     <feature policy='require' name='vme'/>
Jul 27 09:33:02 user nova-compute[70374]:     <feature policy='require' name='x2apic'/>
Jul 27 09:33:02 user nova-compute[70374]:     <feature policy='require' name='hypervisor'/>
Jul 27 09:33:02 user nova-compute[70374]:   </cpu>
Jul 27 09:33:02 user nova-compute[70374]:   <clock offset='utc'>
Jul 27 09:33:02 user nova-compute[70374]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 09:33:02 user nova-compute[70374]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 09:33:02 user nova-compute[70374]:     <timer name='hpet' present='no'/>
Jul 27 09:33:02 user nova-compute[70374]:   </clock>
Jul 27 09:33:02 user nova-compute[70374]:   <on_poweroff>destroy</on_poweroff>
Jul 27 09:33:02 user nova-compute[70374]:   <on_reboot>restart</on_reboot>
Jul 27 09:33:02 user nova-compute[70374]:   <on_crash>destroy</on_crash>
Jul 27 09:33:02 user nova-compute[70374]:   <devices>
Jul 27 09:33:02 user nova-compute[70374]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 09:33:02 user nova-compute[70374]:     <disk type='file' device='disk'>
Jul 27 09:33:02 user nova-compute[70374]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 09:33:02 user nova-compute[70374]:       <source file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk' index='2'/>
Jul 27 09:33:02 user nova-compute[70374]:       <backingStore type='file' index='3'>
Jul 27 09:33:02 user nova-compute[70374]:         <format type='raw'/>
Jul 27 09:33:02 user nova-compute[70374]:         <source file='/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1'/>
Jul 27 09:33:02 user nova-compute[70374]:         <backingStore/>
Jul 27 09:33:02 user nova-compute[70374]:       </backingStore>
Jul 27 09:33:02 user nova-compute[70374]:       <target dev='vda' bus='virtio'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='virtio-disk0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </disk>
Jul 27 09:33:02 user nova-compute[70374]:     <disk type='file' device='cdrom'>
Jul 27 09:33:02 user nova-compute[70374]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 09:33:02 user nova-compute[70374]:       <source file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.config' index='1'/>
Jul 27 09:33:02 user nova-compute[70374]:       <backingStore/>
Jul 27 09:33:02 user nova-compute[70374]:       <target dev='hda' bus='ide'/>
Jul 27 09:33:02 user nova-compute[70374]:       <readonly/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='ide0-0-0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </disk>
Jul 27 09:33:02 user nova-compute[70374]:     <controller type='usb' index='0' model='none'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='usb'/>
Jul 27 09:33:02 user nova-compute[70374]:     </controller>
Jul 27 09:33:02 user nova-compute[70374]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='pci.0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </controller>
Jul 27 09:33:02 user nova-compute[70374]:     <controller type='ide' index='0'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='ide'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 09:33:02 user nova-compute[70374]:     </controller>
Jul 27 09:33:02 user nova-compute[70374]:     <interface type='ethernet'>
Jul 27 09:33:02 user nova-compute[70374]:       <mac address='fa:16:3e:b2:9d:c3'/>
Jul 27 09:33:02 user nova-compute[70374]:       <target dev='tap6bd9ecfd-f7'/>
Jul 27 09:33:02 user nova-compute[70374]:       <model type='virtio'/>
Jul 27 09:33:02 user nova-compute[70374]:       <mtu size='1442'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='net0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </interface>
Jul 27 09:33:02 user nova-compute[70374]:     <serial type='pty'>
Jul 27 09:33:02 user nova-compute[70374]:       <source path='/dev/pts/10'/>
Jul 27 09:33:02 user nova-compute[70374]:       <log file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log' append='off'/>
Jul 27 09:33:02 user nova-compute[70374]:       <target type='isa-serial' port='0'>
Jul 27 09:33:02 user nova-compute[70374]:         <model name='isa-serial'/>
Jul 27 09:33:02 user nova-compute[70374]:       </target>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='serial0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </serial>
Jul 27 09:33:02 user nova-compute[70374]:     <console type='pty' tty='/dev/pts/10'>
Jul 27 09:33:02 user nova-compute[70374]:       <source path='/dev/pts/10'/>
Jul 27 09:33:02 user nova-compute[70374]:       <log file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log' append='off'/>
Jul 27 09:33:02 user nova-compute[70374]:       <target type='serial' port='0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='serial0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </console>
Jul 27 09:33:02 user nova-compute[70374]:     <input type='mouse' bus='ps2'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='input0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </input>
Jul 27 09:33:02 user nova-compute[70374]:     <input type='keyboard' bus='ps2'>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='input1'/>
Jul 27 09:33:02 user nova-compute[70374]:     </input>
Jul 27 09:33:02 user nova-compute[70374]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Jul 27 09:33:02 user nova-compute[70374]:       <listen type='address' address='0.0.0.0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </graphics>
Jul 27 09:33:02 user nova-compute[70374]:     <audio id='1' type='none'/>
Jul 27 09:33:02 user nova-compute[70374]:     <video>
Jul 27 09:33:02 user nova-compute[70374]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='video0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </video>
Jul 27 09:33:02 user nova-compute[70374]:     <memballoon model='virtio'>
Jul 27 09:33:02 user nova-compute[70374]:       <stats period='10'/>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='balloon0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </memballoon>
Jul 27 09:33:02 user nova-compute[70374]:     <rng model='virtio'>
Jul 27 09:33:02 user nova-compute[70374]:       <backend model='random'>/dev/urandom</backend>
Jul 27 09:33:02 user nova-compute[70374]:       <alias name='rng0'/>
Jul 27 09:33:02 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 09:33:02 user nova-compute[70374]:     </rng>
Jul 27 09:33:02 user nova-compute[70374]:   </devices>
Jul 27 09:33:02 user nova-compute[70374]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 09:33:02 user nova-compute[70374]:     <label>libvirt-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</label>
Jul 27 09:33:02 user nova-compute[70374]:     <imagelabel>libvirt-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</imagelabel>
Jul 27 09:33:02 user nova-compute[70374]:   </seclabel>
Jul 27 09:33:02 user nova-compute[70374]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 09:33:02 user nova-compute[70374]:     <label>+64055:+108</label>
Jul 27 09:33:02 user nova-compute[70374]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 09:33:02 user nova-compute[70374]:   </seclabel>
Jul 27 09:33:02 user nova-compute[70374]: </domain>
Jul 27 09:33:02 user nova-compute[70374]:  {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 09:33:02 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Successfully detached device tape86f785e-63 from instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 from the live domain config.
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converting VIF {"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG os_vif [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape86f785e-63, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:02 user nova-compute[70374]: INFO os_vif [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63')
Jul 27 09:33:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:33:02 user nova-compute[70374]:   <nova:package version="0.0.0"/>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:name>tempest-device-tagging-server-175106609</nova:name>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:creationTime>2023-07-27 09:33:02</nova:creationTime>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:flavor name="m1.tiny">
Jul 27 09:33:02 user nova-compute[70374]:     <nova:memory>512</nova:memory>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:disk>1</nova:disk>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:swap>0</nova:swap>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:vcpus>1</nova:vcpus>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:flavor>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:owner>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:user uuid="6d33f8cd041046c18af25f56b63b6bb5">tempest-TaggedAttachmentsTest-493274998-project-member</nova:user>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:project uuid="df3e52a41c1847b199e6dcd09b676fba">tempest-TaggedAttachmentsTest-493274998</nova:project>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:owner>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:33:02 user nova-compute[70374]:   <nova:ports>
Jul 27 09:33:02 user nova-compute[70374]:     <nova:port uuid="6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f">
Jul 27 09:33:02 user nova-compute[70374]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:33:02 user nova-compute[70374]:     </nova:port>
Jul 27 09:33:02 user nova-compute[70374]:   </nova:ports>
Jul 27 09:33:02 user nova-compute[70374]: </nova:instance>
Jul 27 09:33:02 user nova-compute[70374]:  {{(pid=70374) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-ed6bc41b-17bf-4662-ad35-44ddd4179841 req-06999c00-738b-41a1-a4a5-f766bc007c1c service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-unplugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ed6bc41b-17bf-4662-ad35-44ddd4179841 req-06999c00-738b-41a1-a4a5-f766bc007c1c service nova] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ed6bc41b-17bf-4662-ad35-44ddd4179841 req-06999c00-738b-41a1-a4a5-f766bc007c1c service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ed6bc41b-17bf-4662-ad35-44ddd4179841 req-06999c00-738b-41a1-a4a5-f766bc007c1c service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-ed6bc41b-17bf-4662-ad35-44ddd4179841 req-06999c00-738b-41a1-a4a5-f766bc007c1c service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] No waiting events found dispatching network-vif-unplugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:03 user nova-compute[70374]: WARNING nova.compute.manager [req-ed6bc41b-17bf-4662-ad35-44ddd4179841 req-06999c00-738b-41a1-a4a5-f766bc007c1c service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received unexpected event network-vif-unplugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 for instance with vm_state active and task_state None.
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:03 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquired lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.network.neutron [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[765f265d-ecac-4353-a8c8-49c372c08ab7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:33:03 user nova-compute[70374]: No targets found.
Jul 27 09:33:03 user nova-compute[70374]: iSNS:
Jul 27 09:33:03 user nova-compute[70374]: No targets found.
Jul 27 09:33:03 user nova-compute[70374]: STATIC:
Jul 27 09:33:03 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09
Jul 27 09:33:03 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:03 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:03 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:33:03 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:03 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:03 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:33:03 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:03 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:03 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac
Jul 27 09:33:03 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:03 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:03 user nova-compute[70374]: FIRMWARE:
Jul 27 09:33:03 user nova-compute[70374]: No targets found.
Jul 27 09:33:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:33:03 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:33:03 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e2583c-7831-4950-ac88-1edc2d560746]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b95e7-a760-4fb1-a00f-d70505c85853]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:03 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:03 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:03 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:03 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:03 user nova-compute[70374]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:03 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc51e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5abd87-1d8e-4583-8b3d-f964e56e0652]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1f67c2-4396-473a-ab9b-b5f479f48817]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[958544fe-5e70-46dd-9f6f-0cd98ef13081]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-deleted-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:03 user nova-compute[70374]: INFO nova.compute.manager [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Neutron deleted interface e86f785e-63db-4bd0-92b9-6b813174c7a5; detaching it from the instance and deleting it from the info cache
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.network.neutron [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.objects.instance [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] Lazy-loading 'system_metadata' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[713f4fb1-a497-4219-8047-2399c5d84039]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1d606a-887f-4bfa-843f-af896a4905b2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.objects.instance [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] Lazy-loading 'flavor' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f449ec-18ac-4f24-b024-2ad846053b83]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260]
Jul 27 09:33:03 user nova-compute[70374]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260] successful.
Jul 27 09:33:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.network.os_vif_util [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] Converting VIF {"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.network.os_vif_util [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface> {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface>not found in domain: <domain type='kvm' id='11'>
Jul 27 09:33:03 user nova-compute[70374]:   <name>instance-0000000b</name>
Jul 27 09:33:03 user nova-compute[70374]:   <uuid>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</uuid>
Jul 27 09:33:03 user nova-compute[70374]:   <metadata>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:33:03 user nova-compute[70374]:   <nova:package version="0.0.0"/>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:name>tempest-device-tagging-server-175106609</nova:name>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:creationTime>2023-07-27 09:33:02</nova:creationTime>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:flavor name="m1.tiny">
Jul 27 09:33:03 user nova-compute[70374]:     <nova:memory>512</nova:memory>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:disk>1</nova:disk>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:swap>0</nova:swap>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:vcpus>1</nova:vcpus>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:flavor>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:owner>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:user uuid="6d33f8cd041046c18af25f56b63b6bb5">tempest-TaggedAttachmentsTest-493274998-project-member</nova:user>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:project uuid="df3e52a41c1847b199e6dcd09b676fba">tempest-TaggedAttachmentsTest-493274998</nova:project>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:owner>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:ports>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:port uuid="6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f">
Jul 27 09:33:03 user nova-compute[70374]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:33:03 user nova-compute[70374]:     </nova:port>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:ports>
Jul 27 09:33:03 user nova-compute[70374]: </nova:instance>
Jul 27 09:33:03 user nova-compute[70374]:   </metadata>
Jul 27 09:33:03 user nova-compute[70374]:   <memory unit='KiB'>524288</memory>
Jul 27 09:33:03 user nova-compute[70374]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 09:33:03 user nova-compute[70374]:   <vcpu placement='static'>1</vcpu>
Jul 27 09:33:03 user nova-compute[70374]:   <resource>
Jul 27 09:33:03 user nova-compute[70374]:     <partition>/machine</partition>
Jul 27 09:33:03 user nova-compute[70374]:   </resource>
Jul 27 09:33:03 user nova-compute[70374]:   <sysinfo type='smbios'>
Jul 27 09:33:03 user nova-compute[70374]:     <system>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='version'>0.0.0</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='serial'>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='uuid'>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='family'>Virtual Machine</entry>
Jul 27 09:33:03 user nova-compute[70374]:     </system>
Jul 27 09:33:03 user nova-compute[70374]:   </sysinfo>
Jul 27 09:33:03 user nova-compute[70374]:   <os>
Jul 27 09:33:03 user nova-compute[70374]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 09:33:03 user nova-compute[70374]:     <boot dev='hd'/>
Jul 27 09:33:03 user nova-compute[70374]:     <smbios mode='sysinfo'/>
Jul 27 09:33:03 user nova-compute[70374]:   </os>
Jul 27 09:33:03 user nova-compute[70374]:   <features>
Jul 27 09:33:03 user nova-compute[70374]:     <acpi/>
Jul 27 09:33:03 user nova-compute[70374]:     <apic/>
Jul 27 09:33:03 user nova-compute[70374]:     <vmcoreinfo state='on'/>
Jul 27 09:33:03 user nova-compute[70374]:   </features>
Jul 27 09:33:03 user nova-compute[70374]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 09:33:03 user nova-compute[70374]:     <model fallback='forbid'>Nehalem</model>
Jul 27 09:33:03 user nova-compute[70374]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 09:33:03 user nova-compute[70374]:     <feature policy='require' name='vme'/>
Jul 27 09:33:03 user nova-compute[70374]:     <feature policy='require' name='x2apic'/>
Jul 27 09:33:03 user nova-compute[70374]:     <feature policy='require' name='hypervisor'/>
Jul 27 09:33:03 user nova-compute[70374]:   </cpu>
Jul 27 09:33:03 user nova-compute[70374]:   <clock offset='utc'>
Jul 27 09:33:03 user nova-compute[70374]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 09:33:03 user nova-compute[70374]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 09:33:03 user nova-compute[70374]:     <timer name='hpet' present='no'/>
Jul 27 09:33:03 user nova-compute[70374]:   </clock>
Jul 27 09:33:03 user nova-compute[70374]:   <on_poweroff>destroy</on_poweroff>
Jul 27 09:33:03 user nova-compute[70374]:   <on_reboot>restart</on_reboot>
Jul 27 09:33:03 user nova-compute[70374]:   <on_crash>destroy</on_crash>
Jul 27 09:33:03 user nova-compute[70374]:   <devices>
Jul 27 09:33:03 user nova-compute[70374]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 09:33:03 user nova-compute[70374]:     <disk type='file' device='disk'>
Jul 27 09:33:03 user nova-compute[70374]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 09:33:03 user nova-compute[70374]:       <source file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk' index='2'/>
Jul 27 09:33:03 user nova-compute[70374]:       <backingStore type='file' index='3'>
Jul 27 09:33:03 user nova-compute[70374]:         <format type='raw'/>
Jul 27 09:33:03 user nova-compute[70374]:         <source file='/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1'/>
Jul 27 09:33:03 user nova-compute[70374]:         <backingStore/>
Jul 27 09:33:03 user nova-compute[70374]:       </backingStore>
Jul 27 09:33:03 user nova-compute[70374]:       <target dev='vda' bus='virtio'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='virtio-disk0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </disk>
Jul 27 09:33:03 user nova-compute[70374]:     <disk type='file' device='cdrom'>
Jul 27 09:33:03 user nova-compute[70374]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 09:33:03 user nova-compute[70374]:       <source file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.config' index='1'/>
Jul 27 09:33:03 user nova-compute[70374]:       <backingStore/>
Jul 27 09:33:03 user nova-compute[70374]:       <target dev='hda' bus='ide'/>
Jul 27 09:33:03 user nova-compute[70374]:       <readonly/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='ide0-0-0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </disk>
Jul 27 09:33:03 user nova-compute[70374]:     <controller type='usb' index='0' model='none'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='usb'/>
Jul 27 09:33:03 user nova-compute[70374]:     </controller>
Jul 27 09:33:03 user nova-compute[70374]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='pci.0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </controller>
Jul 27 09:33:03 user nova-compute[70374]:     <controller type='ide' index='0'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='ide'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 09:33:03 user nova-compute[70374]:     </controller>
Jul 27 09:33:03 user nova-compute[70374]:     <interface type='ethernet'>
Jul 27 09:33:03 user nova-compute[70374]:       <mac address='fa:16:3e:b2:9d:c3'/>
Jul 27 09:33:03 user nova-compute[70374]:       <target dev='tap6bd9ecfd-f7'/>
Jul 27 09:33:03 user nova-compute[70374]:       <model type='virtio'/>
Jul 27 09:33:03 user nova-compute[70374]:       <mtu size='1442'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='net0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </interface>
Jul 27 09:33:03 user nova-compute[70374]:     <serial type='pty'>
Jul 27 09:33:03 user nova-compute[70374]:       <source path='/dev/pts/10'/>
Jul 27 09:33:03 user nova-compute[70374]:       <log file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log' append='off'/>
Jul 27 09:33:03 user nova-compute[70374]:       <target type='isa-serial' port='0'>
Jul 27 09:33:03 user nova-compute[70374]:         <model name='isa-serial'/>
Jul 27 09:33:03 user nova-compute[70374]:       </target>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='serial0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </serial>
Jul 27 09:33:03 user nova-compute[70374]:     <console type='pty' tty='/dev/pts/10'>
Jul 27 09:33:03 user nova-compute[70374]:       <source path='/dev/pts/10'/>
Jul 27 09:33:03 user nova-compute[70374]:       <log file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log' append='off'/>
Jul 27 09:33:03 user nova-compute[70374]:       <target type='serial' port='0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='serial0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </console>
Jul 27 09:33:03 user nova-compute[70374]:     <input type='mouse' bus='ps2'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='input0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </input>
Jul 27 09:33:03 user nova-compute[70374]:     <input type='keyboard' bus='ps2'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='input1'/>
Jul 27 09:33:03 user nova-compute[70374]:     </input>
Jul 27 09:33:03 user nova-compute[70374]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Jul 27 09:33:03 user nova-compute[70374]:       <listen type='address' address='0.0.0.0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </graphics>
Jul 27 09:33:03 user nova-compute[70374]:     <audio id='1' type='none'/>
Jul 27 09:33:03 user nova-compute[70374]:     <video>
Jul 27 09:33:03 user nova-compute[70374]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='video0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </video>
Jul 27 09:33:03 user nova-compute[70374]:     <memballoon model='virtio'>
Jul 27 09:33:03 user nova-compute[70374]:       <stats period='10'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='balloon0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </memballoon>
Jul 27 09:33:03 user nova-compute[70374]:     <rng model='virtio'>
Jul 27 09:33:03 user nova-compute[70374]:       <backend model='random'>/dev/urandom</backend>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='rng0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </rng>
Jul 27 09:33:03 user nova-compute[70374]:   </devices>
Jul 27 09:33:03 user nova-compute[70374]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 09:33:03 user nova-compute[70374]:     <label>libvirt-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</label>
Jul 27 09:33:03 user nova-compute[70374]:     <imagelabel>libvirt-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</imagelabel>
Jul 27 09:33:03 user nova-compute[70374]:   </seclabel>
Jul 27 09:33:03 user nova-compute[70374]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 09:33:03 user nova-compute[70374]:     <label>+64055:+108</label>
Jul 27 09:33:03 user nova-compute[70374]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 09:33:03 user nova-compute[70374]:   </seclabel>
Jul 27 09:33:03 user nova-compute[70374]: </domain>
Jul 27 09:33:03 user nova-compute[70374]:  {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface> {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[14187ea6-7100-4e7e-92f6-4c78105be34a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] <== disconnect_volume: return (319ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f8:a9:cb"/><model type="virtio"/><mtu size="1442"/><target dev="tape86f785e-63"/></interface>not found in domain: <domain type='kvm' id='11'>
Jul 27 09:33:03 user nova-compute[70374]:   <name>instance-0000000b</name>
Jul 27 09:33:03 user nova-compute[70374]:   <uuid>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</uuid>
Jul 27 09:33:03 user nova-compute[70374]:   <metadata>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:33:03 user nova-compute[70374]:   <nova:package version="0.0.0"/>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:name>tempest-device-tagging-server-175106609</nova:name>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:creationTime>2023-07-27 09:33:02</nova:creationTime>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:flavor name="m1.tiny">
Jul 27 09:33:03 user nova-compute[70374]:     <nova:memory>512</nova:memory>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:disk>1</nova:disk>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:swap>0</nova:swap>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:vcpus>1</nova:vcpus>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:flavor>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:owner>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:user uuid="6d33f8cd041046c18af25f56b63b6bb5">tempest-TaggedAttachmentsTest-493274998-project-member</nova:user>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:project uuid="df3e52a41c1847b199e6dcd09b676fba">tempest-TaggedAttachmentsTest-493274998</nova:project>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:owner>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:ports>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:port uuid="6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f">
Jul 27 09:33:03 user nova-compute[70374]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:33:03 user nova-compute[70374]:     </nova:port>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:ports>
Jul 27 09:33:03 user nova-compute[70374]: </nova:instance>
Jul 27 09:33:03 user nova-compute[70374]:   </metadata>
Jul 27 09:33:03 user nova-compute[70374]:   <memory unit='KiB'>524288</memory>
Jul 27 09:33:03 user nova-compute[70374]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 09:33:03 user nova-compute[70374]:   <vcpu placement='static'>1</vcpu>
Jul 27 09:33:03 user nova-compute[70374]:   <resource>
Jul 27 09:33:03 user nova-compute[70374]:     <partition>/machine</partition>
Jul 27 09:33:03 user nova-compute[70374]:   </resource>
Jul 27 09:33:03 user nova-compute[70374]:   <sysinfo type='smbios'>
Jul 27 09:33:03 user nova-compute[70374]:     <system>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='version'>0.0.0</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='serial'>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='uuid'>b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</entry>
Jul 27 09:33:03 user nova-compute[70374]:       <entry name='family'>Virtual Machine</entry>
Jul 27 09:33:03 user nova-compute[70374]:     </system>
Jul 27 09:33:03 user nova-compute[70374]:   </sysinfo>
Jul 27 09:33:03 user nova-compute[70374]:   <os>
Jul 27 09:33:03 user nova-compute[70374]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 09:33:03 user nova-compute[70374]:     <boot dev='hd'/>
Jul 27 09:33:03 user nova-compute[70374]:     <smbios mode='sysinfo'/>
Jul 27 09:33:03 user nova-compute[70374]:   </os>
Jul 27 09:33:03 user nova-compute[70374]:   <features>
Jul 27 09:33:03 user nova-compute[70374]:     <acpi/>
Jul 27 09:33:03 user nova-compute[70374]:     <apic/>
Jul 27 09:33:03 user nova-compute[70374]:     <vmcoreinfo state='on'/>
Jul 27 09:33:03 user nova-compute[70374]:   </features>
Jul 27 09:33:03 user nova-compute[70374]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 09:33:03 user nova-compute[70374]:     <model fallback='forbid'>Nehalem</model>
Jul 27 09:33:03 user nova-compute[70374]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 09:33:03 user nova-compute[70374]:     <feature policy='require' name='vme'/>
Jul 27 09:33:03 user nova-compute[70374]:     <feature policy='require' name='x2apic'/>
Jul 27 09:33:03 user nova-compute[70374]:     <feature policy='require' name='hypervisor'/>
Jul 27 09:33:03 user nova-compute[70374]:   </cpu>
Jul 27 09:33:03 user nova-compute[70374]:   <clock offset='utc'>
Jul 27 09:33:03 user nova-compute[70374]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 09:33:03 user nova-compute[70374]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 09:33:03 user nova-compute[70374]:     <timer name='hpet' present='no'/>
Jul 27 09:33:03 user nova-compute[70374]:   </clock>
Jul 27 09:33:03 user nova-compute[70374]:   <on_poweroff>destroy</on_poweroff>
Jul 27 09:33:03 user nova-compute[70374]:   <on_reboot>restart</on_reboot>
Jul 27 09:33:03 user nova-compute[70374]:   <on_crash>destroy</on_crash>
Jul 27 09:33:03 user nova-compute[70374]:   <devices>
Jul 27 09:33:03 user nova-compute[70374]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 09:33:03 user nova-compute[70374]:     <disk type='file' device='disk'>
Jul 27 09:33:03 user nova-compute[70374]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 09:33:03 user nova-compute[70374]:       <source file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk' index='2'/>
Jul 27 09:33:03 user nova-compute[70374]:       <backingStore type='file' index='3'>
Jul 27 09:33:03 user nova-compute[70374]:         <format type='raw'/>
Jul 27 09:33:03 user nova-compute[70374]:         <source file='/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1'/>
Jul 27 09:33:03 user nova-compute[70374]:         <backingStore/>
Jul 27 09:33:03 user nova-compute[70374]:       </backingStore>
Jul 27 09:33:03 user nova-compute[70374]:       <target dev='vda' bus='virtio'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='virtio-disk0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </disk>
Jul 27 09:33:03 user nova-compute[70374]:     <disk type='file' device='cdrom'>
Jul 27 09:33:03 user nova-compute[70374]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 09:33:03 user nova-compute[70374]:       <source file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk.config' index='1'/>
Jul 27 09:33:03 user nova-compute[70374]:       <backingStore/>
Jul 27 09:33:03 user nova-compute[70374]:       <target dev='hda' bus='ide'/>
Jul 27 09:33:03 user nova-compute[70374]:       <readonly/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='ide0-0-0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </disk>
Jul 27 09:33:03 user nova-compute[70374]:     <controller type='usb' index='0' model='none'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='usb'/>
Jul 27 09:33:03 user nova-compute[70374]:     </controller>
Jul 27 09:33:03 user nova-compute[70374]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='pci.0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </controller>
Jul 27 09:33:03 user nova-compute[70374]:     <controller type='ide' index='0'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='ide'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 09:33:03 user nova-compute[70374]:     </controller>
Jul 27 09:33:03 user nova-compute[70374]:     <interface type='ethernet'>
Jul 27 09:33:03 user nova-compute[70374]:       <mac address='fa:16:3e:b2:9d:c3'/>
Jul 27 09:33:03 user nova-compute[70374]:       <target dev='tap6bd9ecfd-f7'/>
Jul 27 09:33:03 user nova-compute[70374]:       <model type='virtio'/>
Jul 27 09:33:03 user nova-compute[70374]:       <mtu size='1442'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='net0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </interface>
Jul 27 09:33:03 user nova-compute[70374]:     <serial type='pty'>
Jul 27 09:33:03 user nova-compute[70374]:       <source path='/dev/pts/10'/>
Jul 27 09:33:03 user nova-compute[70374]:       <log file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log' append='off'/>
Jul 27 09:33:03 user nova-compute[70374]:       <target type='isa-serial' port='0'>
Jul 27 09:33:03 user nova-compute[70374]:         <model name='isa-serial'/>
Jul 27 09:33:03 user nova-compute[70374]:       </target>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='serial0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </serial>
Jul 27 09:33:03 user nova-compute[70374]:     <console type='pty' tty='/dev/pts/10'>
Jul 27 09:33:03 user nova-compute[70374]:       <source path='/dev/pts/10'/>
Jul 27 09:33:03 user nova-compute[70374]:       <log file='/opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/console.log' append='off'/>
Jul 27 09:33:03 user nova-compute[70374]:       <target type='serial' port='0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='serial0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </console>
Jul 27 09:33:03 user nova-compute[70374]:     <input type='mouse' bus='ps2'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='input0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </input>
Jul 27 09:33:03 user nova-compute[70374]:     <input type='keyboard' bus='ps2'>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='input1'/>
Jul 27 09:33:03 user nova-compute[70374]:     </input>
Jul 27 09:33:03 user nova-compute[70374]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Jul 27 09:33:03 user nova-compute[70374]:       <listen type='address' address='0.0.0.0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </graphics>
Jul 27 09:33:03 user nova-compute[70374]:     <audio id='1' type='none'/>
Jul 27 09:33:03 user nova-compute[70374]:     <video>
Jul 27 09:33:03 user nova-compute[70374]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='video0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </video>
Jul 27 09:33:03 user nova-compute[70374]:     <memballoon model='virtio'>
Jul 27 09:33:03 user nova-compute[70374]:       <stats period='10'/>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='balloon0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </memballoon>
Jul 27 09:33:03 user nova-compute[70374]:     <rng model='virtio'>
Jul 27 09:33:03 user nova-compute[70374]:       <backend model='random'>/dev/urandom</backend>
Jul 27 09:33:03 user nova-compute[70374]:       <alias name='rng0'/>
Jul 27 09:33:03 user nova-compute[70374]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 09:33:03 user nova-compute[70374]:     </rng>
Jul 27 09:33:03 user nova-compute[70374]:   </devices>
Jul 27 09:33:03 user nova-compute[70374]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 09:33:03 user nova-compute[70374]:     <label>libvirt-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</label>
Jul 27 09:33:03 user nova-compute[70374]:     <imagelabel>libvirt-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06</imagelabel>
Jul 27 09:33:03 user nova-compute[70374]:   </seclabel>
Jul 27 09:33:03 user nova-compute[70374]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 09:33:03 user nova-compute[70374]:     <label>+64055:+108</label>
Jul 27 09:33:03 user nova-compute[70374]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 09:33:03 user nova-compute[70374]:   </seclabel>
Jul 27 09:33:03 user nova-compute[70374]: </domain>
Jul 27 09:33:03 user nova-compute[70374]:  {{(pid=70374) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 09:33:03 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Detaching interface fa:16:3e:f8:a9:cb failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tape86f785e-63' not found.
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.network.os_vif_util [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] Converting VIF {"id": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "address": "fa:16:3e:f8:a9:cb", "network": {"id": "f4c65a93-da7c-42e7-9c5e-c721d1ecb59e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-193407618", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86f785e-63", "ovs_interfaceid": "e86f785e-63db-4bd0-92b9-6b813174c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.network.os_vif_util [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG os_vif [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape86f785e-63, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:33:03 user nova-compute[70374]: INFO os_vif [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a9:cb,bridge_name='br-int',has_traffic_filtering=True,id=e86f785e-63db-4bd0-92b9-6b813174c7a5,network=Network(f4c65a93-da7c-42e7-9c5e-c721d1ecb59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86f785e-63')
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [req-6c3ed29d-7dbb-4a48-9ecd-b6e62693a6e1 req-0d3c65e7-800b-4f1d-bf6e-cf297bd4ea35 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:33:03 user nova-compute[70374]:   <nova:package version="0.0.0"/>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:name>tempest-device-tagging-server-175106609</nova:name>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:creationTime>2023-07-27 09:33:03</nova:creationTime>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:flavor name="m1.tiny">
Jul 27 09:33:03 user nova-compute[70374]:     <nova:memory>512</nova:memory>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:disk>1</nova:disk>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:swap>0</nova:swap>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:vcpus>1</nova:vcpus>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:flavor>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:owner>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:user uuid="6d33f8cd041046c18af25f56b63b6bb5">tempest-TaggedAttachmentsTest-493274998-project-member</nova:user>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:project uuid="df3e52a41c1847b199e6dcd09b676fba">tempest-TaggedAttachmentsTest-493274998</nova:project>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:owner>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:33:03 user nova-compute[70374]:   <nova:ports>
Jul 27 09:33:03 user nova-compute[70374]:     <nova:port uuid="6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f">
Jul 27 09:33:03 user nova-compute[70374]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:33:03 user nova-compute[70374]:     </nova:port>
Jul 27 09:33:03 user nova-compute[70374]:   </nova:ports>
Jul 27 09:33:03 user nova-compute[70374]: </nova:instance>
Jul 27 09:33:03 user nova-compute[70374]:  {{(pid=70374) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhDngcBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd35fe056-8279-479a-a673-6c61e5ec6933', 'attached_at': '', 'detached_at': '', 'volume_id': '4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'serial'} {{(pid=70374) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] swap_volume: removing Cinder connection for volume 25fa94b4-c6dc-4dbd-add9-e3a58523baac {{(pid=70374) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 09:33:03 user nova-compute[70374]: INFO nova.network.neutron [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Port e86f785e-63db-4bd0-92b9-6b813174c7a5 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 27 09:33:03 user nova-compute[70374]: DEBUG nova.network.neutron [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [{"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Releasing lock "refresh_cache-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:33:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c3ac937b-bb60-485a-a5b2-386f3c4d2423 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "interface-b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-e86f785e-63db-4bd0-92b9-6b813174c7a5" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.566s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] swap_volume: Updating volume 25fa94b4-c6dc-4dbd-add9-e3a58523baac BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "MhDngcBP", "auth_password": "3HioaEGQv7COTB", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "4f6a5d8f-095f-487e-b752-c9b1ce301b09"}, "status": "reserved", "instance": "d35fe056-8279-479a-a673-6c61e5ec6933", "attached_at": "", "detached_at": "", "volume_id": "4f6a5d8f-095f-487e-b752-c9b1ce301b09", "serial": "4f6a5d8f-095f-487e-b752-c9b1ce301b09"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'no_device': None, 'attachment_id': 'd55330fc-a58a-4b49-9de3-a9dd321e261f'} {{(pid=70374) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-62d0b1f3-25c5-4ce5-b0b8-f241dda8b5a4 tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.489s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450369.5376472, 773917c6-56d7-4491-a760-05f51593b7f0 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:33:04 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] VM Stopped (Lifecycle Event)
Jul 27 09:33:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-083756f8-0ef1-49fa-bd16-3e1b1ff26aa9 None None] [instance: 773917c6-56d7-4491-a760-05f51593b7f0] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updating instance_info_cache with network_info: [{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:33:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-398b3685-48ac-42fd-a713-0d361083322a req-4a06270e-0055-49b4-858c-4a4288e602b0 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-398b3685-48ac-42fd-a713-0d361083322a req-4a06270e-0055-49b4-858c-4a4288e602b0 service nova] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-398b3685-48ac-42fd-a713-0d361083322a req-4a06270e-0055-49b4-858c-4a4288e602b0 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-398b3685-48ac-42fd-a713-0d361083322a req-4a06270e-0055-49b4-858c-4a4288e602b0 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-398b3685-48ac-42fd-a713-0d361083322a req-4a06270e-0055-49b4-858c-4a4288e602b0 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] No waiting events found dispatching network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:05 user nova-compute[70374]: WARNING nova.compute.manager [req-398b3685-48ac-42fd-a713-0d361083322a req-4a06270e-0055-49b4-858c-4a4288e602b0 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received unexpected event network-vif-plugged-e86f785e-63db-4bd0-92b9-6b813174c7a5 for instance with vm_state active and task_state None.
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG os_brick.utils [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43feffc-7b68-4010-9764-67090b26aad3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[270b5434-4769-4414-99bd-9ff8fef61f4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dcbc72-8d98-49a8-877d-bdf13f6479d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ba6c10-3593-4fdd-9b30-95e57c7a5f71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:33:05 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9054dd-4007-4156-85c0-2840391e5295]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG os_brick.utils [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:05 user nova-compute[70374]: INFO nova.compute.manager [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Swapping volume 4f6a5d8f-095f-487e-b752-c9b1ce301b09 for 25fa94b4-c6dc-4dbd-add9-e3a58523baac
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:09 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:33:09 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=6899MB free_disk=25.599098205566406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 42f4c546-47e4-485b-be29-4081c7557bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance d35fe056-8279-479a-a673-6c61e5ec6933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance a72e9d21-b1f4-4e61-8875-c72d7ce88a32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 2e225354-053f-48f5-ad3f-6662b627d531 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:33:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35fe056-8279-479a-a673-6c61e5ec6933', 'attached_at': '', 'detached_at': '', 'volume_id': '25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'serial': '25fa94b4-c6dc-4dbd-add9-e3a58523baac'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhDngcBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '4f6a5d8f-095f-487e-b752-c9b1ce301b09'}, 'status': 'reserved', 'instance': 'd35fe056-8279-479a-a673-6c61e5ec6933', 'attached_at': '', 'detached_at': '', 'volume_id': '4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'serial'} {{(pid=70374) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:12 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:12 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:12 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3010b5-5bd5-446f-910c-24f0d7505a7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:33:12 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1777fe26-e84e-45c4-b6c6-48e1f743b5af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac] added
Jul 27 09:33:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8572f1-9a0e-4e7f-9502-2fd3058ea78e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c85bd3-cadd-4822-829e-bf5cf3968802]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUpudWeL {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUpudWeL" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[11950621-c09f-4550-ad0d-47f2954c7ad1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KUpudWeL'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ff26c-4598-4ccd-8b14-f2087fe5bc22]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[09951f13-039a-457b-b7a8-8ebf075dcfe6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bedd33-3bc5-433c-bf6a-901881a9cf34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260]
Jul 27 09:33:12 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260] successful.
Jul 27 09:33:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabeb10b-0ab4-432b-a5f6-2bf8371dfdd9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c1f1fd-2462-45f5-b13a-76d48b356a13]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a1d989-7629-4296-8161-1155e1a5e2ef]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:33:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23065313130373465', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065313130373465', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:33:13 user nova-compute[70374]: DEBUG nova.objects.instance [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lazy-loading 'flavor' on Instance uuid d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 175112192 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:14 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450379.672595, 309c9c26-4a0f-45db-bb3a-595b19f3f627 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:33:14 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] VM Stopped (Lifecycle Event)
Jul 27 09:33:14 user nova-compute[70374]: DEBUG nova.compute.manager [None req-25fbea64-13ef-4189-a7ba-343907b31a5b None None] [instance: 309c9c26-4a0f-45db-bb3a-595b19f3f627] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:33:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 367001600 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 548405248 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 685768704 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 860880896 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 1022361600 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhDngcBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '4f6a5d8f-095f-487e-b752-c9b1ce301b09'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:17 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7527ae-7f36-4607-a8da-279f760bdae4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:33:17 user nova-compute[70374]: No targets found.
Jul 27 09:33:17 user nova-compute[70374]: iSNS:
Jul 27 09:33:17 user nova-compute[70374]: No targets found.
Jul 27 09:33:17 user nova-compute[70374]: STATIC:
Jul 27 09:33:17 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09
Jul 27 09:33:17 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:17 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:17 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:33:17 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:17 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:17 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:33:17 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:17 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:17 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac
Jul 27 09:33:17 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:17 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:17 user nova-compute[70374]: FIRMWARE:
Jul 27 09:33:17 user nova-compute[70374]: No targets found.
Jul 27 09:33:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:33:17 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:33:17 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9973d581-f589-40a8-bfab-e42067aea228]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e2982d-a9da-4476-9cf4-de4ac4b241cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:17 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:17 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:17 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:17 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:17 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:17 user nova-compute[70374]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 (non-flash)
Jul 27 09:33:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc700160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09'): ({'sdf'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Removing single pathed devices sdf {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c68fc61-1a5c-4c01-b42b-162b91d4e585]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1cf1fd-fb13-4cfc-a620-918c67699900]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Flushing IO for device /dev/sdf {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61624a6-1bb6-4473-8fb7-7525cf002ecc]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a108a672-2978-4414-94ba-77a908c271a7]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] SCSI volumes sdf have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[069e470e-2d2e-4926-80bb-0e664d588ae1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85aea41-e2ba-4c8e-b57c-9c027edc25ba]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09, portal: 172.16.0.220,3260]
Jul 27 09:33:17 user nova-compute[70374]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09, portal: 172.16.0.220,3260] successful.
Jul 27 09:33:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6a5d8f-095f-487e-b752-c9b1ce301b09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0829e94c-e149-4c93-b167-68a4f1461662]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] <== disconnect_volume: return (298ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:33:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd35fe056-8279-479a-a673-6c61e5ec6933', 'attached_at': '', 'detached_at': '', 'volume_id': '25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'serial'} {{(pid=70374) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 09:33:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] swap_volume: removing Cinder connection for volume 4f6a5d8f-095f-487e-b752-c9b1ce301b09 {{(pid=70374) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 09:33:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] swap_volume: Updating volume 4f6a5d8f-095f-487e-b752-c9b1ce301b09 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KUpudWeL", "auth_password": "Gzw8CtETXY3oFv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "25fa94b4-c6dc-4dbd-add9-e3a58523baac"}, "status": "reserved", "instance": "d35fe056-8279-479a-a673-6c61e5ec6933", "attached_at": "", "detached_at": "", "volume_id": "25fa94b4-c6dc-4dbd-add9-e3a58523baac", "serial": "25fa94b4-c6dc-4dbd-add9-e3a58523baac"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'no_device': None, 'attachment_id': 'c25057b8-06b5-47dc-b13f-76212ae363b2'} {{(pid=70374) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 09:33:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-57eacd0d-51c2-4963-8e86-9b621746037c tempest-TestVolumeSwap-1311737041 tempest-TestVolumeSwap-1311737041-project-admin] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.484s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:19 user nova-compute[70374]: INFO nova.compute.manager [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Detaching volume 25fa94b4-c6dc-4dbd-add9-e3a58523baac
Jul 27 09:33:19 user nova-compute[70374]: INFO nova.virt.block_device [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Attempting to driver detach volume 25fa94b4-c6dc-4dbd-add9-e3a58523baac from mountpoint /dev/vdb
Jul 27 09:33:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Attempting to detach device vdb from instance d35fe056-8279-479a-a673-6c61e5ec6933 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:33:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:33:19 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:33:19 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:33:19 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:33:19 user nova-compute[70374]:   <serial>25fa94b4-c6dc-4dbd-add9-e3a58523baac</serial>
Jul 27 09:33:19 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:33:19 user nova-compute[70374]: </disk>
Jul 27 09:33:19 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:33:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Successfully detached device vdb from instance d35fe056-8279-479a-a673-6c61e5ec6933 from the persistent domain config.
Jul 27 09:33:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d35fe056-8279-479a-a673-6c61e5ec6933 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:33:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:33:19 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:33:19 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:33:19 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:33:19 user nova-compute[70374]:   <serial>25fa94b4-c6dc-4dbd-add9-e3a58523baac</serial>
Jul 27 09:33:19 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:33:19 user nova-compute[70374]: </disk>
Jul 27 09:33:19 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450400.2422836, d35fe056-8279-479a-a673-6c61e5ec6933 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:33:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Successfully detached device vdb from instance d35fe056-8279-479a-a673-6c61e5ec6933 from the live domain config.
Jul 27 09:33:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUpudWeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '25fa94b4-c6dc-4dbd-add9-e3a58523baac'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:20 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5152af55-efa1-43f3-8ca1-05ab15332b75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:33:20 user nova-compute[70374]: No targets found.
Jul 27 09:33:20 user nova-compute[70374]: iSNS:
Jul 27 09:33:20 user nova-compute[70374]: No targets found.
Jul 27 09:33:20 user nova-compute[70374]: STATIC:
Jul 27 09:33:20 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:33:20 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:20 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:20 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:33:20 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:20 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:20 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac
Jul 27 09:33:20 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:20 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:20 user nova-compute[70374]: FIRMWARE:
Jul 27 09:33:20 user nova-compute[70374]: No targets found.
Jul 27 09:33:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:33:20 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:33:20 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa19da0-4fa8-4f32-be45-dba27462b043]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[69928a0f-eab1-43b8-823f-a730d75abd5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:20 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:20 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac (non-flash)
Jul 27 09:33:20 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:20 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280e614af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e77d718-5f96-4afb-a975-c16f500c0d9b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e220d7f6-4f37-4929-8bcb-a82e5d00526b]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[041eb5ff-6c37-41a1-84d6-2fd8583e234d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1f0ad7-c01a-4b1a-aff8-7debec031c67]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.143s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[66065b9c-0bab-441e-a3bd-357ac8210dad]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[04049cdd-c13e-4622-abba-1fb257fe8f23]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260]
Jul 27 09:33:20 user nova-compute[70374]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac, portal: 172.16.0.220,3260] successful.
Jul 27 09:33:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fa94b4-c6dc-4dbd-add9-e3a58523baac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[faecdb2d-bdbd-41ac-bf7d-b15ea64f5ebb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] <== disconnect_volume: return (428ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:33:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lazy-loading 'flavor' on Instance uuid d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-47ef6609-4a23-40fc-9efc-4d67aa7889f6 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.896s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "30aa3eca-5c9f-443a-af70-461010d4e22e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:33:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:33:31 user nova-compute[70374]: INFO nova.compute.claims [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Claim successful on node user
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:33:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.policy [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b56b56f07f0c4674a09485173c97fd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c072c9f639974ac186a9d8b94baaab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:33:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Creating image(s)
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "/opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "/opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "/opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk 1073741824" returned: 0 in 0.058s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:32 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Cannot resize image /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'migration_context' on Instance uuid 30aa3eca-5c9f-443a-af70-461010d4e22e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Ensure instance console log exists: /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Successfully created port: 412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Successfully updated port: 412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquired lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-2dcb2e72-b74b-4aff-a87d-bd64451911df req-d8fb8c0a-3ed6-47be-aece-6af488104a5d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received event network-changed-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-2dcb2e72-b74b-4aff-a87d-bd64451911df req-d8fb8c0a-3ed6-47be-aece-6af488104a5d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Refreshing instance network info cache due to event network-changed-412b86f3-01b6-4a35-897b-3f886d1444ea. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2dcb2e72-b74b-4aff-a87d-bd64451911df req-d8fb8c0a-3ed6-47be-aece-6af488104a5d service nova] Acquiring lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:33:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Updating instance_info_cache with network_info: [{"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Releasing lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Instance network_info: |[{"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2dcb2e72-b74b-4aff-a87d-bd64451911df req-d8fb8c0a-3ed6-47be-aece-6af488104a5d service nova] Acquired lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-2dcb2e72-b74b-4aff-a87d-bd64451911df req-d8fb8c0a-3ed6-47be-aece-6af488104a5d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Refreshing network info cache for port 412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Start _get_guest_xml network_info=[{"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:33:34 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:33:34 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1083315878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1083315878',id=15,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7LVTKkV6OndxlbHZqrPuCTqVnrPWGC0Yf+dDzj7YRVKGGE7K+jaweaReXgsGRfDABP3IqlurlpPr2agY7QyFjVleFoaB+gzWVpxdLtiL7Si0bN6oMPicUyfI4Wxs1gxg==',key_name='tempest-keypair-1564014618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-ofzqtwtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=30aa3eca-5c9f-443a-af70-461010d4e22e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:50:77,bridge_name='br-int',has_traffic_filtering=True,id=412b86f3-01b6-4a35-897b-3f886d1444ea,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412b86f3-01') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'pci_devices' on Instance uuid 30aa3eca-5c9f-443a-af70-461010d4e22e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:33:34 user nova-compute[70374]:   <uuid>30aa3eca-5c9f-443a-af70-461010d4e22e</uuid>
Jul 27 09:33:34 user nova-compute[70374]:   <name>instance-0000000f</name>
Jul 27 09:33:34 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:33:34 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:33:34 user nova-compute[70374]:   <metadata>
Jul 27 09:33:34 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:33:34 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:33:34 user nova-compute[70374]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1083315878</nova:name>
Jul 27 09:33:34 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:33:34</nova:creationTime>
Jul 27 09:33:34 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:33:34 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:33:34 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:33:34 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:33:34 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:33:34 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:33:34 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:33:34 user nova-compute[70374]:       <nova:owner>
Jul 27 09:33:34 user nova-compute[70374]:         <nova:user uuid="b56b56f07f0c4674a09485173c97fd4f">tempest-ServerActionsV293TestJSON-405523215-project-member</nova:user>
Jul 27 09:33:34 user nova-compute[70374]:         <nova:project uuid="c072c9f639974ac186a9d8b94baaab20">tempest-ServerActionsV293TestJSON-405523215</nova:project>
Jul 27 09:33:34 user nova-compute[70374]:       </nova:owner>
Jul 27 09:33:34 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:33:34 user nova-compute[70374]:       <nova:ports>
Jul 27 09:33:34 user nova-compute[70374]:         <nova:port uuid="412b86f3-01b6-4a35-897b-3f886d1444ea">
Jul 27 09:33:34 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 09:33:34 user nova-compute[70374]:         </nova:port>
Jul 27 09:33:34 user nova-compute[70374]:       </nova:ports>
Jul 27 09:33:34 user nova-compute[70374]:     </nova:instance>
Jul 27 09:33:34 user nova-compute[70374]:   </metadata>
Jul 27 09:33:34 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:33:34 user nova-compute[70374]:     <system>
Jul 27 09:33:34 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:33:34 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:33:34 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:33:34 user nova-compute[70374]:       <entry name="serial">30aa3eca-5c9f-443a-af70-461010d4e22e</entry>
Jul 27 09:33:34 user nova-compute[70374]:       <entry name="uuid">30aa3eca-5c9f-443a-af70-461010d4e22e</entry>
Jul 27 09:33:34 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:33:34 user nova-compute[70374]:     </system>
Jul 27 09:33:34 user nova-compute[70374]:   </sysinfo>
Jul 27 09:33:34 user nova-compute[70374]:   <os>
Jul 27 09:33:34 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:33:34 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:33:34 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:33:34 user nova-compute[70374]:   </os>
Jul 27 09:33:34 user nova-compute[70374]:   <features>
Jul 27 09:33:34 user nova-compute[70374]:     <acpi/>
Jul 27 09:33:34 user nova-compute[70374]:     <apic/>
Jul 27 09:33:34 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:33:34 user nova-compute[70374]:   </features>
Jul 27 09:33:34 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:33:34 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:33:34 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:33:34 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:33:34 user nova-compute[70374]:   </clock>
Jul 27 09:33:34 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:33:34 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:33:34 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:33:34 user nova-compute[70374]:   </cpu>
Jul 27 09:33:34 user nova-compute[70374]:   <devices>
Jul 27 09:33:34 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:33:34 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:33:34 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk"/>
Jul 27 09:33:34 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:33:34 user nova-compute[70374]:     </disk>
Jul 27 09:33:34 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:33:34 user nova-compute[70374]:       <mac address="fa:16:3e:3b:50:77"/>
Jul 27 09:33:34 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:33:34 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:33:34 user nova-compute[70374]:       <target dev="tap412b86f3-01"/>
Jul 27 09:33:34 user nova-compute[70374]:     </interface>
Jul 27 09:33:34 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:33:34 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/console.log" append="off"/>
Jul 27 09:33:34 user nova-compute[70374]:     </serial>
Jul 27 09:33:34 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:33:34 user nova-compute[70374]:     <video>
Jul 27 09:33:34 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:33:34 user nova-compute[70374]:     </video>
Jul 27 09:33:34 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:33:34 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:33:34 user nova-compute[70374]:     </rng>
Jul 27 09:33:34 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:33:34 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:33:34 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:33:34 user nova-compute[70374]:     </memballoon>
Jul 27 09:33:34 user nova-compute[70374]:   </devices>
Jul 27 09:33:34 user nova-compute[70374]: </domain>
Jul 27 09:33:34 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1083315878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1083315878',id=15,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7LVTKkV6OndxlbHZqrPuCTqVnrPWGC0Yf+dDzj7YRVKGGE7K+jaweaReXgsGRfDABP3IqlurlpPr2agY7QyFjVleFoaB+gzWVpxdLtiL7Si0bN6oMPicUyfI4Wxs1gxg==',key_name='tempest-keypair-1564014618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-ofzqtwtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=30aa3eca-5c9f-443a-af70-461010d4e22e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:50:77,bridge_name='br-int',has_traffic_filtering=True,id=412b86f3-01b6-4a35-897b-3f886d1444ea,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412b86f3-01') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG os_vif [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:50:77,bridge_name='br-int',has_traffic_filtering=True,id=412b86f3-01b6-4a35-897b-3f886d1444ea,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412b86f3-01') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap412b86f3-01, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap412b86f3-01, col_values=(('external_ids', {'iface-id': '412b86f3-01b6-4a35-897b-3f886d1444ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:50:77', 'vm-uuid': '30aa3eca-5c9f-443a-af70-461010d4e22e'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:34 user nova-compute[70374]: INFO os_vif [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:50:77,bridge_name='br-int',has_traffic_filtering=True,id=412b86f3-01b6-4a35-897b-3f886d1444ea,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412b86f3-01')
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] No VIF found with MAC fa:16:3e:3b:50:77, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-2dcb2e72-b74b-4aff-a87d-bd64451911df req-d8fb8c0a-3ed6-47be-aece-6af488104a5d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Updated VIF entry in instance network info cache for port 412b86f3-01b6-4a35-897b-3f886d1444ea. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-2dcb2e72-b74b-4aff-a87d-bd64451911df req-d8fb8c0a-3ed6-47be-aece-6af488104a5d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Updating instance_info_cache with network_info: [{"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2dcb2e72-b74b-4aff-a87d-bd64451911df req-d8fb8c0a-3ed6-47be-aece-6af488104a5d service nova] Releasing lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "e987c251-fdaf-4a37-ad66-9305e529428e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "e987c251-fdaf-4a37-ad66-9305e529428e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:33:35 user nova-compute[70374]: INFO nova.compute.claims [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Claim successful on node user
Jul 27 09:33:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-d1275f05-2c11-4130-960a-a2e26672e893 req-250ee997-a1b6-41b9-b756-6ee5e26dd4ed service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received event network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1275f05-2c11-4130-960a-a2e26672e893 req-250ee997-a1b6-41b9-b756-6ee5e26dd4ed service nova] Acquiring lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1275f05-2c11-4130-960a-a2e26672e893 req-250ee997-a1b6-41b9-b756-6ee5e26dd4ed service nova] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1275f05-2c11-4130-960a-a2e26672e893 req-250ee997-a1b6-41b9-b756-6ee5e26dd4ed service nova] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-d1275f05-2c11-4130-960a-a2e26672e893 req-250ee997-a1b6-41b9-b756-6ee5e26dd4ed service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] No waiting events found dispatching network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:36 user nova-compute[70374]: WARNING nova.compute.manager [req-d1275f05-2c11-4130-960a-a2e26672e893 req-250ee997-a1b6-41b9-b756-6ee5e26dd4ed service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received unexpected event network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea for instance with vm_state building and task_state spawning.
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.policy [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9eecf77414d9472e9e3cd10aec673afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3b4d25fdc94c4ea2e148e16478b40c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:33:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Creating image(s)
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "/opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "/opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "/opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.259s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.174s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk 1073741824" returned: 0 in 0.051s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Successfully created port: 39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Cannot resize image /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'migration_context' on Instance uuid e987c251-fdaf-4a37-ad66-9305e529428e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Ensure instance console log exists: /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Successfully updated port: 39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "refresh_cache-e987c251-fdaf-4a37-ad66-9305e529428e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquired lock "refresh_cache-e987c251-fdaf-4a37-ad66-9305e529428e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received event network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] Acquiring lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] No waiting events found dispatching network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:38 user nova-compute[70374]: WARNING nova.compute.manager [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received unexpected event network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea for instance with vm_state building and task_state spawning.
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received event network-changed-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Refreshing instance network info cache due to event network-changed-39d6be6a-9951-4831-a632-a151532c0878. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] Acquiring lock "refresh_cache-e987c251-fdaf-4a37-ad66-9305e529428e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450418.2126067, 30aa3eca-5c9f-443a-af70-461010d4e22e => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:33:38 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] VM Resumed (Lifecycle Event)
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:33:38 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Instance spawned successfully.
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:38 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450418.214661, 30aa3eca-5c9f-443a-af70-461010d4e22e => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:33:38 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] VM Started (Lifecycle Event)
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:33:38 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:33:38 user nova-compute[70374]: INFO nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Took 5.98 seconds to spawn the instance on the hypervisor.
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:33:38 user nova-compute[70374]: INFO nova.compute.manager [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Took 6.72 seconds to build instance.
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0bba539d-f57e-4634-b48e-50e5b9324fe0 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Updating instance_info_cache with network_info: [{"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Releasing lock "refresh_cache-e987c251-fdaf-4a37-ad66-9305e529428e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Instance network_info: |[{"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] Acquired lock "refresh_cache-e987c251-fdaf-4a37-ad66-9305e529428e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Refreshing network info cache for port 39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Start _get_guest_xml network_info=[{"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:33:38 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:33:38 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:33:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-956267581',display_name='tempest-VolumesAdminNegativeTest-server-956267581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-956267581',id=16,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa3b4d25fdc94c4ea2e148e16478b40c',ramdisk_id='',reservation_id='r-rsfdvwyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1398001736',owner_user_name='tempest-VolumesAdminNegativeTest-1398001736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:33:37Z,user_data=None,user_id='9eecf77414d9472e9e3cd10aec673afb',uuid=e987c251-fdaf-4a37-ad66-9305e529428e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converting VIF {"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:0e:b2,bridge_name='br-int',has_traffic_filtering=True,id=39d6be6a-9951-4831-a632-a151532c0878,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39d6be6a-99') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'pci_devices' on Instance uuid e987c251-fdaf-4a37-ad66-9305e529428e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:33:38 user nova-compute[70374]:   <uuid>e987c251-fdaf-4a37-ad66-9305e529428e</uuid>
Jul 27 09:33:38 user nova-compute[70374]:   <name>instance-00000010</name>
Jul 27 09:33:38 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:33:38 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:33:38 user nova-compute[70374]:   <metadata>
Jul 27 09:33:38 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:33:38 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:33:38 user nova-compute[70374]:       <nova:name>tempest-VolumesAdminNegativeTest-server-956267581</nova:name>
Jul 27 09:33:38 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:33:38</nova:creationTime>
Jul 27 09:33:38 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:33:38 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:33:38 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:33:38 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:33:38 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:33:38 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:33:38 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:33:38 user nova-compute[70374]:       <nova:owner>
Jul 27 09:33:38 user nova-compute[70374]:         <nova:user uuid="9eecf77414d9472e9e3cd10aec673afb">tempest-VolumesAdminNegativeTest-1398001736-project-member</nova:user>
Jul 27 09:33:38 user nova-compute[70374]:         <nova:project uuid="aa3b4d25fdc94c4ea2e148e16478b40c">tempest-VolumesAdminNegativeTest-1398001736</nova:project>
Jul 27 09:33:38 user nova-compute[70374]:       </nova:owner>
Jul 27 09:33:38 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:33:38 user nova-compute[70374]:       <nova:ports>
Jul 27 09:33:38 user nova-compute[70374]:         <nova:port uuid="39d6be6a-9951-4831-a632-a151532c0878">
Jul 27 09:33:38 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 09:33:38 user nova-compute[70374]:         </nova:port>
Jul 27 09:33:38 user nova-compute[70374]:       </nova:ports>
Jul 27 09:33:38 user nova-compute[70374]:     </nova:instance>
Jul 27 09:33:38 user nova-compute[70374]:   </metadata>
Jul 27 09:33:38 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:33:38 user nova-compute[70374]:     <system>
Jul 27 09:33:38 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:33:38 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:33:38 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:33:38 user nova-compute[70374]:       <entry name="serial">e987c251-fdaf-4a37-ad66-9305e529428e</entry>
Jul 27 09:33:38 user nova-compute[70374]:       <entry name="uuid">e987c251-fdaf-4a37-ad66-9305e529428e</entry>
Jul 27 09:33:38 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:33:38 user nova-compute[70374]:     </system>
Jul 27 09:33:38 user nova-compute[70374]:   </sysinfo>
Jul 27 09:33:38 user nova-compute[70374]:   <os>
Jul 27 09:33:38 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:33:38 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:33:38 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:33:38 user nova-compute[70374]:   </os>
Jul 27 09:33:38 user nova-compute[70374]:   <features>
Jul 27 09:33:38 user nova-compute[70374]:     <acpi/>
Jul 27 09:33:38 user nova-compute[70374]:     <apic/>
Jul 27 09:33:38 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:33:38 user nova-compute[70374]:   </features>
Jul 27 09:33:38 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:33:38 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:33:38 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:33:38 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:33:38 user nova-compute[70374]:   </clock>
Jul 27 09:33:38 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:33:38 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:33:38 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:33:38 user nova-compute[70374]:   </cpu>
Jul 27 09:33:38 user nova-compute[70374]:   <devices>
Jul 27 09:33:38 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:33:38 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:33:38 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk"/>
Jul 27 09:33:38 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:33:38 user nova-compute[70374]:     </disk>
Jul 27 09:33:38 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:33:38 user nova-compute[70374]:       <mac address="fa:16:3e:66:0e:b2"/>
Jul 27 09:33:38 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:33:38 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:33:38 user nova-compute[70374]:       <target dev="tap39d6be6a-99"/>
Jul 27 09:33:38 user nova-compute[70374]:     </interface>
Jul 27 09:33:38 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:33:38 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/console.log" append="off"/>
Jul 27 09:33:38 user nova-compute[70374]:     </serial>
Jul 27 09:33:38 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:33:38 user nova-compute[70374]:     <video>
Jul 27 09:33:38 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:33:38 user nova-compute[70374]:     </video>
Jul 27 09:33:38 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:33:38 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:33:38 user nova-compute[70374]:     </rng>
Jul 27 09:33:38 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:33:38 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:33:38 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:33:38 user nova-compute[70374]:     </memballoon>
Jul 27 09:33:38 user nova-compute[70374]:   </devices>
Jul 27 09:33:38 user nova-compute[70374]: </domain>
Jul 27 09:33:38 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:33:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-956267581',display_name='tempest-VolumesAdminNegativeTest-server-956267581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-956267581',id=16,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa3b4d25fdc94c4ea2e148e16478b40c',ramdisk_id='',reservation_id='r-rsfdvwyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1398001736',owner_user_name='tempest-VolumesAdminNegativeTest-1398001736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:33:37Z,user_data=None,user_id='9eecf77414d9472e9e3cd10aec673afb',uuid=e987c251-fdaf-4a37-ad66-9305e529428e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converting VIF {"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:0e:b2,bridge_name='br-int',has_traffic_filtering=True,id=39d6be6a-9951-4831-a632-a151532c0878,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39d6be6a-99') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG os_vif [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:0e:b2,bridge_name='br-int',has_traffic_filtering=True,id=39d6be6a-9951-4831-a632-a151532c0878,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39d6be6a-99') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39d6be6a-99, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39d6be6a-99, col_values=(('external_ids', {'iface-id': '39d6be6a-9951-4831-a632-a151532c0878', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:0e:b2', 'vm-uuid': 'e987c251-fdaf-4a37-ad66-9305e529428e'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:38 user nova-compute[70374]: INFO os_vif [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:0e:b2,bridge_name='br-int',has_traffic_filtering=True,id=39d6be6a-9951-4831-a632-a151532c0878,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39d6be6a-99')
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:33:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] No VIF found with MAC fa:16:3e:66:0e:b2, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:33:39 user nova-compute[70374]: DEBUG nova.network.neutron [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Updated VIF entry in instance network info cache for port 39d6be6a-9951-4831-a632-a151532c0878. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:33:39 user nova-compute[70374]: DEBUG nova.network.neutron [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Updating instance_info_cache with network_info: [{"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a54348b-2531-4b84-868e-d6ca121d6a40 req-c77e2676-422b-4440-b63a-5b4301c315ab service nova] Releasing lock "refresh_cache-e987c251-fdaf-4a37-ad66-9305e529428e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:33:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-0e97d029-f1ee-4ab1-9dea-9eeb89d79640 req-a823f455-7c3c-4d86-b005-93728af1bcd7 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received event network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0e97d029-f1ee-4ab1-9dea-9eeb89d79640 req-a823f455-7c3c-4d86-b005-93728af1bcd7 service nova] Acquiring lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0e97d029-f1ee-4ab1-9dea-9eeb89d79640 req-a823f455-7c3c-4d86-b005-93728af1bcd7 service nova] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0e97d029-f1ee-4ab1-9dea-9eeb89d79640 req-a823f455-7c3c-4d86-b005-93728af1bcd7 service nova] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-0e97d029-f1ee-4ab1-9dea-9eeb89d79640 req-a823f455-7c3c-4d86-b005-93728af1bcd7 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] No waiting events found dispatching network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:40 user nova-compute[70374]: WARNING nova.compute.manager [req-0e97d029-f1ee-4ab1-9dea-9eeb89d79640 req-a823f455-7c3c-4d86-b005-93728af1bcd7 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received unexpected event network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 for instance with vm_state building and task_state spawning.
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450422.4015954, e987c251-fdaf-4a37-ad66-9305e529428e => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:33:42 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] VM Resumed (Lifecycle Event)
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:33:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Instance spawned successfully.
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:33:42 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450422.4027991, e987c251-fdaf-4a37-ad66-9305e529428e => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:33:42 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] VM Started (Lifecycle Event)
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-801ce960-94e8-47a6-9d47-622562471b55 req-2073bffe-faba-4a84-85e5-c08bd0e7faa0 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received event network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-801ce960-94e8-47a6-9d47-622562471b55 req-2073bffe-faba-4a84-85e5-c08bd0e7faa0 service nova] Acquiring lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-801ce960-94e8-47a6-9d47-622562471b55 req-2073bffe-faba-4a84-85e5-c08bd0e7faa0 service nova] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-801ce960-94e8-47a6-9d47-622562471b55 req-2073bffe-faba-4a84-85e5-c08bd0e7faa0 service nova] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-801ce960-94e8-47a6-9d47-622562471b55 req-2073bffe-faba-4a84-85e5-c08bd0e7faa0 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] No waiting events found dispatching network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:42 user nova-compute[70374]: WARNING nova.compute.manager [req-801ce960-94e8-47a6-9d47-622562471b55 req-2073bffe-faba-4a84-85e5-c08bd0e7faa0 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received unexpected event network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 for instance with vm_state building and task_state spawning.
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:33:42 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:33:42 user nova-compute[70374]: INFO nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Took 5.84 seconds to spawn the instance on the hypervisor.
Jul 27 09:33:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:33:42 user nova-compute[70374]: INFO nova.compute.manager [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Took 6.93 seconds to build instance.
Jul 27 09:33:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b629bc2d-49f8-4dee-82f4-5a717a73d5a6 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "e987c251-fdaf-4a37-ad66-9305e529428e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.044s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-343e3028-b4cd-4e24-b7b9-17e71b106468 req-86e13b1a-6e3e-4bfe-89f5-b7e5ab866aa6 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-changed-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-343e3028-b4cd-4e24-b7b9-17e71b106468 req-86e13b1a-6e3e-4bfe-89f5-b7e5ab866aa6 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Refreshing instance network info cache due to event network-changed-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-343e3028-b4cd-4e24-b7b9-17e71b106468 req-86e13b1a-6e3e-4bfe-89f5-b7e5ab866aa6 service nova] Acquiring lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-343e3028-b4cd-4e24-b7b9-17e71b106468 req-86e13b1a-6e3e-4bfe-89f5-b7e5ab866aa6 service nova] Acquired lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG nova.network.neutron [req-343e3028-b4cd-4e24-b7b9-17e71b106468 req-86e13b1a-6e3e-4bfe-89f5-b7e5ab866aa6 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Refreshing network info cache for port faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'flavor' on Instance uuid ea21f129-1e0a-4ad1-b516-c2a8f92835b7 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-343e3028-b4cd-4e24-b7b9-17e71b106468 req-86e13b1a-6e3e-4bfe-89f5-b7e5ab866aa6 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Updated VIF entry in instance network info cache for port faecacb1-2e14-4d38-8c90-bfb3ff5e23a7. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-343e3028-b4cd-4e24-b7b9-17e71b106468 req-86e13b1a-6e3e-4bfe-89f5-b7e5ab866aa6 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Updating instance_info_cache with network_info: [{"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:45 user nova-compute[70374]: INFO nova.compute.manager [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Attaching volume 625bf38d-20b9-47ce-b253-c064ac65b048 to /dev/vdb
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-343e3028-b4cd-4e24-b7b9-17e71b106468 req-86e13b1a-6e3e-4bfe-89f5-b7e5ab866aa6 service nova] Releasing lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG os_brick.utils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[775d9bd7-2715-429a-81b4-f4ad877b1193]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f4a608-16c7-46e9-ae0b-8c93e94feac6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a702584-31b3-48e4-93f6-b83aca8e61d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b202ebea-72f7-4771-9c1c-d529176c9bd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:33:45 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:33:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8884afe9-632b-48c6-98f6-35bda6a822a0]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG os_brick.utils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:45 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Updating existing volume attachment record: 7c911b59-4400-4039-99fd-972c10c4f3f1 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:48 user nova-compute[70374]: INFO nova.compute.manager [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Terminating instance
Jul 27 09:33:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-f4fdd1b7-b2c3-4b08-96c5-22eeca20a233 req-a99496ac-a21c-4fcf-9ebb-b31afa87f2a5 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received event network-vif-unplugged-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f4fdd1b7-b2c3-4b08-96c5-22eeca20a233 req-a99496ac-a21c-4fcf-9ebb-b31afa87f2a5 service nova] Acquiring lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f4fdd1b7-b2c3-4b08-96c5-22eeca20a233 req-a99496ac-a21c-4fcf-9ebb-b31afa87f2a5 service nova] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f4fdd1b7-b2c3-4b08-96c5-22eeca20a233 req-a99496ac-a21c-4fcf-9ebb-b31afa87f2a5 service nova] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-f4fdd1b7-b2c3-4b08-96c5-22eeca20a233 req-a99496ac-a21c-4fcf-9ebb-b31afa87f2a5 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] No waiting events found dispatching network-vif-unplugged-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-f4fdd1b7-b2c3-4b08-96c5-22eeca20a233 req-a99496ac-a21c-4fcf-9ebb-b31afa87f2a5 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received event network-vif-unplugged-75f39855-7414-4b71-a4a8-553502aa8627 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Instance destroyed successfully.
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lazy-loading 'resources' on Instance uuid a72e9d21-b1f4-4e61-8875-c72d7ce88a32 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1038287225',display_name='tempest-ServersNegativeTestJSON-server-1038287225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1038287225',id=13,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:32:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65e935bb36794aa98eb3e94c30e647d9',ramdisk_id='',reservation_id='r-ocrv8sa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1865798359',owner_user_name='tempest-ServersNegativeTestJSON-1865798359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:32:06Z,user_data=None,user_id='544aa4a40ff941c2a52b24faa08a0d29',uuid=a72e9d21-b1f4-4e61-8875-c72d7ce88a32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converting VIF {"id": "75f39855-7414-4b71-a4a8-553502aa8627", "address": "fa:16:3e:34:5c:8c", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f39855-74", "ovs_interfaceid": "75f39855-7414-4b71-a4a8-553502aa8627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5c:8c,bridge_name='br-int',has_traffic_filtering=True,id=75f39855-7414-4b71-a4a8-553502aa8627,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f39855-74') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG os_vif [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5c:8c,bridge_name='br-int',has_traffic_filtering=True,id=75f39855-7414-4b71-a4a8-553502aa8627,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f39855-74') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75f39855-74, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:49 user nova-compute[70374]: INFO os_vif [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5c:8c,bridge_name='br-int',has_traffic_filtering=True,id=75f39855-7414-4b71-a4a8-553502aa8627,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f39855-74')
Jul 27 09:33:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Deleting instance files /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32_del
Jul 27 09:33:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Deletion of /opt/stack/data/nova/instances/a72e9d21-b1f4-4e61-8875-c72d7ce88a32_del complete
Jul 27 09:33:49 user nova-compute[70374]: INFO nova.compute.manager [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Took 0.80 seconds to destroy the instance on the hypervisor.
Jul 27 09:33:49 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:33:49 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:33:50 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:50 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Took 1.23 seconds to deallocate network for instance.
Jul 27 09:33:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-af5bae13-b10a-4e3c-b510-8b29a629292d req-ea9553c2-0b2c-4318-a597-7aa2683a9ee6 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received event network-vif-deleted-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:50 user nova-compute[70374]: INFO nova.compute.manager [req-af5bae13-b10a-4e3c-b510-8b29a629292d req-ea9553c2-0b2c-4318-a597-7aa2683a9ee6 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Neutron deleted interface 75f39855-7414-4b71-a4a8-553502aa8627; detaching it from the instance and deleting it from the info cache
Jul 27 09:33:50 user nova-compute[70374]: DEBUG nova.network.neutron [req-af5bae13-b10a-4e3c-b510-8b29a629292d req-ea9553c2-0b2c-4318-a597-7aa2683a9ee6 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-af5bae13-b10a-4e3c-b510-8b29a629292d req-ea9553c2-0b2c-4318-a597-7aa2683a9ee6 service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Detach interface failed, port_id=75f39855-7414-4b71-a4a8-553502aa8627, reason: Instance a72e9d21-b1f4-4e61-8875-c72d7ce88a32 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:33:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:51 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:33:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-a1c3db20-8afb-4668-b88e-c11b7929edf8 req-a439ed63-b225-4263-a3e5-e7bd99c04a6f service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received event network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a1c3db20-8afb-4668-b88e-c11b7929edf8 req-a439ed63-b225-4263-a3e5-e7bd99c04a6f service nova] Acquiring lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a1c3db20-8afb-4668-b88e-c11b7929edf8 req-a439ed63-b225-4263-a3e5-e7bd99c04a6f service nova] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a1c3db20-8afb-4668-b88e-c11b7929edf8 req-a439ed63-b225-4263-a3e5-e7bd99c04a6f service nova] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-a1c3db20-8afb-4668-b88e-c11b7929edf8 req-a439ed63-b225-4263-a3e5-e7bd99c04a6f service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] No waiting events found dispatching network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:51 user nova-compute[70374]: WARNING nova.compute.manager [req-a1c3db20-8afb-4668-b88e-c11b7929edf8 req-a439ed63-b225-4263-a3e5-e7bd99c04a6f service nova] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Received unexpected event network-vif-plugged-75f39855-7414-4b71-a4a8-553502aa8627 for instance with vm_state deleted and task_state None.
Jul 27 09:33:51 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:33:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:51 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Deleted allocations for instance a72e9d21-b1f4-4e61-8875-c72d7ce88a32
Jul 27 09:33:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d4c0efc7-f53d-4cf2-9aa8-a05793001471 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "a72e9d21-b1f4-4e61-8875-c72d7ce88a32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.705s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHZdrieq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:52 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:52 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:52 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53629a0-291d-4eb2-bc3d-0d84d2d5f86e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:33:52 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede7a9e8-1dd0-4481-a1f7-ed40b77f40d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048] added
Jul 27 09:33:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b526a7fb-139a-42d2-a7df-75107ae00729]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c0a75d-655b-4455-8902-79dff89756b1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHZdrieq {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHZdrieq" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceec5b3-1645-4718-aaa5-bea24d9f8f71]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jHZdrieq'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[870954bb-d718-4a77-b927-8de10b5764a7]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad6f423-80f9-474c-8a85-9e5e2b74e91b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f1d0d0-744b-4de1-a296-c7d75a63041d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048, portal: 172.16.0.220,3260]
Jul 27 09:33:53 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048, portal: 172.16.0.220,3260] successful.
Jul 27 09:33:53 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4d2c11-2f2e-4c43-a1d1-37a79249c555]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf760176-6ba1-4c75-9702-a950cc64bdf6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:53 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c799e2-857e-4db6-ad94-14f8f0cdf4b3]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHZdrieq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:53 user nova-compute[70374]: INFO nova.compute.manager [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Terminating instance
Jul 27 09:33:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-d4f9ea45-c29c-4f65-aead-0a7bfee6f5dc req-a39de32a-859d-4479-938d-1431cb8d2699 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-unplugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d4f9ea45-c29c-4f65-aead-0a7bfee6f5dc req-a39de32a-859d-4479-938d-1431cb8d2699 service nova] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d4f9ea45-c29c-4f65-aead-0a7bfee6f5dc req-a39de32a-859d-4479-938d-1431cb8d2699 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d4f9ea45-c29c-4f65-aead-0a7bfee6f5dc req-a39de32a-859d-4479-938d-1431cb8d2699 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-d4f9ea45-c29c-4f65-aead-0a7bfee6f5dc req-a39de32a-859d-4479-938d-1431cb8d2699 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] No waiting events found dispatching network-vif-unplugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-d4f9ea45-c29c-4f65-aead-0a7bfee6f5dc req-a39de32a-859d-4479-938d-1431cb8d2699 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-unplugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:54 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Instance destroyed successfully.
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.objects.instance [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lazy-loading 'resources' on Instance uuid b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26630393065643563', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630393065643563', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-175106609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-175106609',id=11,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTnqzjorB039ilJl8VK7YcSm6BfDbMAMeMlN6KuNuE2BR5Ci7E8V9F4eHRzTVNR5ErMNNWpJQddk0yLJsVN++T9e5hUTfZ9niEsaZXI1P72KyNTxQBI7EWBQg10Ylojmg==',key_name='tempest-keypair-693359237',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df3e52a41c1847b199e6dcd09b676fba',ramdisk_id='',reservation_id='r-tordp007',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-493274998',owner_user_name='tempest-TaggedAttachmentsTest-493274998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d33f8cd041046c18af25f56b63b6bb5',uuid=b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converting VIF {"id": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "address": "fa:16:3e:b2:9d:c3", "network": {"id": "158fe9d2-5b60-4b57-bdcb-10de0604f194", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1646104715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df3e52a41c1847b199e6dcd09b676fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9ecfd-f7", "ovs_interfaceid": "6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9d:c3,bridge_name='br-int',has_traffic_filtering=True,id=6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f,network=Network(158fe9d2-5b60-4b57-bdcb-10de0604f194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9ecfd-f7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG os_vif [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9d:c3,bridge_name='br-int',has_traffic_filtering=True,id=6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f,network=Network(158fe9d2-5b60-4b57-bdcb-10de0604f194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9ecfd-f7') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bd9ecfd-f7, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.objects.instance [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'flavor' on Instance uuid ea21f129-1e0a-4ad1-b516-c2a8f92835b7 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:54 user nova-compute[70374]: INFO os_vif [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9d:c3,bridge_name='br-int',has_traffic_filtering=True,id=6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f,network=Network(158fe9d2-5b60-4b57-bdcb-10de0604f194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9ecfd-f7')
Jul 27 09:33:54 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Deleting instance files /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06_del
Jul 27 09:33:54 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Deletion of /opt/stack/data/nova/instances/b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06_del complete
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:33:54 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:33:54 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:33:54 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:33:54 user nova-compute[70374]:   <serial>625bf38d-20b9-47ce-b253-c064ac65b048</serial>
Jul 27 09:33:54 user nova-compute[70374]: </disk>
Jul 27 09:33:54 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:33:54 user nova-compute[70374]: INFO nova.compute.manager [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 27 09:33:54 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No VIF found with MAC fa:16:3e:37:d2:3d, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:33:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-dc26f76d-f09a-4d57-8980-dc2f307476cf tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.590s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:55 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Took 0.85 seconds to deallocate network for instance.
Jul 27 09:33:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-8cb44257-f3ab-44e0-8e34-97b7f45e2995 req-eab01ce7-3fac-4450-b05b-18d7a6b8676b service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-deleted-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:55 user nova-compute[70374]: INFO nova.compute.manager [req-8cb44257-f3ab-44e0-8e34-97b7f45e2995 req-eab01ce7-3fac-4450-b05b-18d7a6b8676b service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Neutron deleted interface 6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f; detaching it from the instance and deleting it from the info cache
Jul 27 09:33:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-8cb44257-f3ab-44e0-8e34-97b7f45e2995 req-eab01ce7-3fac-4450-b05b-18d7a6b8676b service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-8cb44257-f3ab-44e0-8e34-97b7f45e2995 req-eab01ce7-3fac-4450-b05b-18d7a6b8676b service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Detach interface failed, port_id=6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f, reason: Instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:55 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Deleted allocations for instance b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06
Jul 27 09:33:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-18b44d1c-8eac-4f66-b64a-f874c239bf0e req-227bb339-004c-4b18-90e6-fec7a0d2e587 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received event network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-18b44d1c-8eac-4f66-b64a-f874c239bf0e req-227bb339-004c-4b18-90e6-fec7a0d2e587 service nova] Acquiring lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-18b44d1c-8eac-4f66-b64a-f874c239bf0e req-227bb339-004c-4b18-90e6-fec7a0d2e587 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-18b44d1c-8eac-4f66-b64a-f874c239bf0e req-227bb339-004c-4b18-90e6-fec7a0d2e587 service nova] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-18b44d1c-8eac-4f66-b64a-f874c239bf0e req-227bb339-004c-4b18-90e6-fec7a0d2e587 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] No waiting events found dispatching network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:33:55 user nova-compute[70374]: WARNING nova.compute.manager [req-18b44d1c-8eac-4f66-b64a-f874c239bf0e req-227bb339-004c-4b18-90e6-fec7a0d2e587 service nova] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Received unexpected event network-vif-plugged-6bd9ecfd-f75a-4f30-9be8-b4dd315cb41f for instance with vm_state deleted and task_state None.
Jul 27 09:33:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-11486478-e1dc-4d4b-a8be-0d3af66fa924 tempest-TaggedAttachmentsTest-493274998 tempest-TaggedAttachmentsTest-493274998-project-member] Lock "b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:33:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:33:56 user nova-compute[70374]: INFO nova.compute.manager [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Detaching volume 625bf38d-20b9-47ce-b253-c064ac65b048
Jul 27 09:33:56 user nova-compute[70374]: INFO nova.virt.block_device [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Attempting to driver detach volume 625bf38d-20b9-47ce-b253-c064ac65b048 from mountpoint /dev/vdb
Jul 27 09:33:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Attempting to detach device vdb from instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:33:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:33:56 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:33:56 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:33:56 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:33:56 user nova-compute[70374]:   <serial>625bf38d-20b9-47ce-b253-c064ac65b048</serial>
Jul 27 09:33:56 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:33:56 user nova-compute[70374]: </disk>
Jul 27 09:33:56 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:33:56 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Successfully detached device vdb from instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 from the persistent domain config.
Jul 27 09:33:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:33:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:33:56 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:33:56 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:33:56 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:33:56 user nova-compute[70374]:   <serial>625bf38d-20b9-47ce-b253-c064ac65b048</serial>
Jul 27 09:33:56 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:33:56 user nova-compute[70374]: </disk>
Jul 27 09:33:56 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450437.0281844, ea21f129-1e0a-4ad1-b516-c2a8f92835b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:33:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Successfully detached device vdb from instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 from the live domain config.
Jul 27 09:33:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHZdrieq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:33:57 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d200964-57d2-4477-8e2b-b05215331518]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:33:57 user nova-compute[70374]: No targets found.
Jul 27 09:33:57 user nova-compute[70374]: iSNS:
Jul 27 09:33:57 user nova-compute[70374]: No targets found.
Jul 27 09:33:57 user nova-compute[70374]: STATIC:
Jul 27 09:33:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048
Jul 27 09:33:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:33:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:33:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:33:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:33:57 user nova-compute[70374]: FIRMWARE:
Jul 27 09:33:57 user nova-compute[70374]: No targets found.
Jul 27 09:33:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:33:57 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:33:57 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7222b4-cd1e-431c-bec2-5eb46fb194a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5653ade4-decd-45b0-8d50-a96e13bf85cc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 (non-flash)
Jul 27 09:33:57 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:57 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 (non-flash)
Jul 27 09:33:57 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:33:57 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:33:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc51fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc6641c-3de1-4a87-8c22-3779e3e5a727]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfe47cf-3589-4cfa-b9e8-b221850098bc]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feb6cdf-20da-43ef-befd-c1ba9c36f269]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c72d360-1936-4b4f-95ab-0c2b86399ab5]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bb3117-4142-4ad6-909f-d02e837e7086]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e101bc-2f56-4466-96fd-27d8d72f8e7d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048, portal: 172.16.0.220,3260]
Jul 27 09:33:57 user nova-compute[70374]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048, portal: 172.16.0.220,3260] successful.
Jul 27 09:33:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625bf38d-20b9-47ce-b253-c064ac65b048 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c8a0fc-f383-4444-8204-b6630915d276]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] <== disconnect_volume: return (297ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:33:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:33:58 user nova-compute[70374]: DEBUG nova.objects.instance [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'flavor' on Instance uuid ea21f129-1e0a-4ad1-b516-c2a8f92835b7 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:33:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-421c1a21-3fb8-4c6b-b701-3ff9b301eb80 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:33:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:33:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:04 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450429.2283854, a72e9d21-b1f4-4e61-8875-c72d7ce88a32 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:34:04 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] VM Stopped (Lifecycle Event)
Jul 27 09:34:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-55e7209a-2a04-4894-8c3e-e4d0cce63ca5 None None] [instance: a72e9d21-b1f4-4e61-8875-c72d7ce88a32] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updating instance_info_cache with network_info: [{"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:05 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450434.2108912, b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:34:09 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] VM Stopped (Lifecycle Event)
Jul 27 09:34:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-aae674c2-1960-4426-89b7-24166bb17b4f None None] [instance: b6e0f7ba-3fbf-4ecf-bfb4-f818302dde06] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:34:10 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:34:10 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7327MB free_disk=25.62560272216797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:10 user nova-compute[70374]: INFO nova.compute.manager [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Terminating instance
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 42f4c546-47e4-485b-be29-4081c7557bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance d35fe056-8279-479a-a673-6c61e5ec6933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 2e225354-053f-48f5-ad3f-6662b627d531 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 30aa3eca-5c9f-443a-af70-461010d4e22e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance e987c251-fdaf-4a37-ad66-9305e529428e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-304f1b3f-cbed-4b08-b7f1-01a69e1ff62b req-e0552f35-d31d-4c21-a46c-0c481693b4a1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received event network-vif-unplugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-304f1b3f-cbed-4b08-b7f1-01a69e1ff62b req-e0552f35-d31d-4c21-a46c-0c481693b4a1 service nova] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-304f1b3f-cbed-4b08-b7f1-01a69e1ff62b req-e0552f35-d31d-4c21-a46c-0c481693b4a1 service nova] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-304f1b3f-cbed-4b08-b7f1-01a69e1ff62b req-e0552f35-d31d-4c21-a46c-0c481693b4a1 service nova] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-304f1b3f-cbed-4b08-b7f1-01a69e1ff62b req-e0552f35-d31d-4c21-a46c-0c481693b4a1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] No waiting events found dispatching network-vif-unplugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:34:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-304f1b3f-cbed-4b08-b7f1-01a69e1ff62b req-e0552f35-d31d-4c21-a46c-0c481693b4a1 service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received event network-vif-unplugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Instance destroyed successfully.
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.objects.instance [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lazy-loading 'resources' on Instance uuid d35fe056-8279-479a-a673-6c61e5ec6933 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1780453082',display_name='tempest-TestVolumeSwap-server-1780453082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1780453082',id=9,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaNbtFtor1bqTgF+b2crgVHLS9gnhKdKp9dMQdiKNpBIvJQwJpmePSBuDiTyWesfiLJRcs+yKbdVF9O+syPsBVqVGKrGBXSpMVjRmnYBFtocxj+nET2lsNkoXtTK+YyzQ==',key_name='tempest-keypair-612516559',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2010f7a57b654bee8736f3ed8d805b2c',ramdisk_id='',reservation_id='r-d2e70j2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-987419093',owner_user_name='tempest-TestVolumeSwap-987419093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:30:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9597f10b87aa426b812375b1770d3095',uuid=d35fe056-8279-479a-a673-6c61e5ec6933,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Converting VIF {"id": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "address": "fa:16:3e:2d:07:78", "network": {"id": "aead18f5-45fa-4ce5-9c4a-086f9f9d07e6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-383523410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2010f7a57b654bee8736f3ed8d805b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap018c2bfb-40", "ovs_interfaceid": "018c2bfb-405c-4bba-a54f-e8ea773e57bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:07:78,bridge_name='br-int',has_traffic_filtering=True,id=018c2bfb-405c-4bba-a54f-e8ea773e57bf,network=Network(aead18f5-45fa-4ce5-9c4a-086f9f9d07e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018c2bfb-40') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG os_vif [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:07:78,bridge_name='br-int',has_traffic_filtering=True,id=018c2bfb-405c-4bba-a54f-e8ea773e57bf,network=Network(aead18f5-45fa-4ce5-9c4a-086f9f9d07e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018c2bfb-40') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap018c2bfb-40, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:11 user nova-compute[70374]: INFO os_vif [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:07:78,bridge_name='br-int',has_traffic_filtering=True,id=018c2bfb-405c-4bba-a54f-e8ea773e57bf,network=Network(aead18f5-45fa-4ce5-9c4a-086f9f9d07e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap018c2bfb-40')
Jul 27 09:34:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Deleting instance files /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933_del
Jul 27 09:34:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Deletion of /opt/stack/data/nova/instances/d35fe056-8279-479a-a673-6c61e5ec6933_del complete
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:34:11 user nova-compute[70374]: INFO nova.compute.manager [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 27 09:34:11 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:34:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-c0383a7b-6fdd-4b3a-9615-b5c09204b035 req-9188990b-4f0f-492a-aa89-7c220141696b service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received event network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c0383a7b-6fdd-4b3a-9615-b5c09204b035 req-9188990b-4f0f-492a-aa89-7c220141696b service nova] Acquiring lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c0383a7b-6fdd-4b3a-9615-b5c09204b035 req-9188990b-4f0f-492a-aa89-7c220141696b service nova] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c0383a7b-6fdd-4b3a-9615-b5c09204b035 req-9188990b-4f0f-492a-aa89-7c220141696b service nova] Lock "d35fe056-8279-479a-a673-6c61e5ec6933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-c0383a7b-6fdd-4b3a-9615-b5c09204b035 req-9188990b-4f0f-492a-aa89-7c220141696b service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] No waiting events found dispatching network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:34:12 user nova-compute[70374]: WARNING nova.compute.manager [req-c0383a7b-6fdd-4b3a-9615-b5c09204b035 req-9188990b-4f0f-492a-aa89-7c220141696b service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received unexpected event network-vif-plugged-018c2bfb-405c-4bba-a54f-e8ea773e57bf for instance with vm_state active and task_state deleting.
Jul 27 09:34:12 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:13 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Took 1.54 seconds to deallocate network for instance.
Jul 27 09:34:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:13 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:34:13 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:34:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:13 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Deleted allocations for instance d35fe056-8279-479a-a673-6c61e5ec6933
Jul 27 09:34:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5abb1b7f-87a6-4b0a-b188-3f23fa04d156 tempest-TestVolumeSwap-987419093 tempest-TestVolumeSwap-987419093-project-member] Lock "d35fe056-8279-479a-a673-6c61e5ec6933" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.220s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:14 user nova-compute[70374]: DEBUG nova.compute.manager [req-7576d51b-0fd4-4a13-9550-926b34575c7c req-bffc2011-7832-4c40-ade8-a4173be04d1e service nova] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Received event network-vif-deleted-018c2bfb-405c-4bba-a54f-e8ea773e57bf {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-d920091e-17c4-490c-8718-e3d471e31867 req-6328f4eb-888e-4c91-99a7-a8b33b40b307 service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received event network-changed-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-d920091e-17c4-490c-8718-e3d471e31867 req-6328f4eb-888e-4c91-99a7-a8b33b40b307 service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Refreshing instance network info cache due to event network-changed-ddf41035-1805-4fde-b4cf-d86ab3e59c3b. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:34:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d920091e-17c4-490c-8718-e3d471e31867 req-6328f4eb-888e-4c91-99a7-a8b33b40b307 service nova] Acquiring lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d920091e-17c4-490c-8718-e3d471e31867 req-6328f4eb-888e-4c91-99a7-a8b33b40b307 service nova] Acquired lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:17 user nova-compute[70374]: DEBUG nova.network.neutron [req-d920091e-17c4-490c-8718-e3d471e31867 req-6328f4eb-888e-4c91-99a7-a8b33b40b307 service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Refreshing network info cache for port ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "2e225354-053f-48f5-ad3f-6662b627d531" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "2e225354-053f-48f5-ad3f-6662b627d531" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "2e225354-053f-48f5-ad3f-6662b627d531-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:18 user nova-compute[70374]: INFO nova.compute.manager [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Terminating instance
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquired lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'info_cache' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Instance destroyed successfully.
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'resources' on Instance uuid 2e225354-053f-48f5-ad3f-6662b627d531 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-471243575',display_name='tempest-AttachVolumeNegativeTest-server-471243575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-471243575',id=14,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXIUeFJxpF4vk5nlGGsHNsBOgmU9WA3rEQ6vxDmkBZP7AGy3dWxt/NMowMl08/WRjc5o5ePL2B6OPh8GFtYgtYo1IQP06pzdbpul/oSVpQqD1ny9pUHoKY28t+y4OcZng==',key_name='tempest-keypair-254621140',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-w8tuz66i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=2e225354-053f-48f5-ad3f-6662b627d531,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=ddf41035-1805-4fde-b4cf-d86ab3e59c3b,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf41035-18') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG os_vif [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=ddf41035-1805-4fde-b4cf-d86ab3e59c3b,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf41035-18') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf41035-18, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: INFO os_vif [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cc:69,bridge_name='br-int',has_traffic_filtering=True,id=ddf41035-1805-4fde-b4cf-d86ab3e59c3b,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf41035-18')
Jul 27 09:34:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Deleting instance files /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531_del
Jul 27 09:34:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Deletion of /opt/stack/data/nova/instances/2e225354-053f-48f5-ad3f-6662b627d531_del complete
Jul 27 09:34:18 user nova-compute[70374]: INFO nova.compute.manager [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 27 09:34:18 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:34:18 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG nova.network.neutron [req-d920091e-17c4-490c-8718-e3d471e31867 req-6328f4eb-888e-4c91-99a7-a8b33b40b307 service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Updated VIF entry in instance network info cache for port ddf41035-1805-4fde-b4cf-d86ab3e59c3b. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG nova.network.neutron [req-d920091e-17c4-490c-8718-e3d471e31867 req-6328f4eb-888e-4c91-99a7-a8b33b40b307 service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Updating instance_info_cache with network_info: [{"id": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "address": "fa:16:3e:e4:cc:69", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf41035-18", "ovs_interfaceid": "ddf41035-1805-4fde-b4cf-d86ab3e59c3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d920091e-17c4-490c-8718-e3d471e31867 req-6328f4eb-888e-4c91-99a7-a8b33b40b307 service nova] Releasing lock "refresh_cache-2e225354-053f-48f5-ad3f-6662b627d531" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-f459ee01-4db2-43dd-91b5-cc8f71c024d6 req-69905b2f-1e01-4350-9fa1-9f1e17462a3c service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received event network-vif-unplugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f459ee01-4db2-43dd-91b5-cc8f71c024d6 req-69905b2f-1e01-4350-9fa1-9f1e17462a3c service nova] Acquiring lock "2e225354-053f-48f5-ad3f-6662b627d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f459ee01-4db2-43dd-91b5-cc8f71c024d6 req-69905b2f-1e01-4350-9fa1-9f1e17462a3c service nova] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f459ee01-4db2-43dd-91b5-cc8f71c024d6 req-69905b2f-1e01-4350-9fa1-9f1e17462a3c service nova] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-f459ee01-4db2-43dd-91b5-cc8f71c024d6 req-69905b2f-1e01-4350-9fa1-9f1e17462a3c service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] No waiting events found dispatching network-vif-unplugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-f459ee01-4db2-43dd-91b5-cc8f71c024d6 req-69905b2f-1e01-4350-9fa1-9f1e17462a3c service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received event network-vif-unplugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updating instance_info_cache with network_info: [{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Releasing lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance destroyed successfully.
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'resources' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_vif [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb825d9b4-15, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:34:20 user nova-compute[70374]: INFO os_vif [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15')
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmCwbdGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:34:20 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8caa0c-7420-4d4e-9865-194f1be97aef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:34:20 user nova-compute[70374]: No targets found.
Jul 27 09:34:20 user nova-compute[70374]: iSNS:
Jul 27 09:34:20 user nova-compute[70374]: No targets found.
Jul 27 09:34:20 user nova-compute[70374]: STATIC:
Jul 27 09:34:20 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:34:20 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:34:20 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:34:20 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:34:20 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:34:20 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:34:20 user nova-compute[70374]: FIRMWARE:
Jul 27 09:34:20 user nova-compute[70374]: No targets found.
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:34:20 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:34:20 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70851b-6c2f-4812-8c71-b805a858ea30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff6c4f-33f1-490c-8ee6-1e35049edf75]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc08c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5749b21-589e-4326-bb2d-1247b714892d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64cb5cf-ac9d-44f8-84c3-098002c13adc]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848c1bc-e903-4bba-b254-b098fdfe7284]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55338ed-efc4-4d13-979e-3ef5b50574c9]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db8745e-cd41-48d1-b6a0-b6153ee1e737]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f484308-bbff-4133-9f55-81807bbcd778]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260]
Jul 27 09:34:20 user nova-compute[70374]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260] successful.
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16197c-fa51-4035-9b5f-b13c07dbe322]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== disconnect_volume: return (312ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Start _get_guest_xml network_info=[{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '3329de24-8de5-4111-84db-b9a71d949e64', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmCwbdGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '25214e8a-c626-46a7-b273-eb491c2fc91b', 'attached_at': '', 'detached_at': '', 'volume_id': '788f71f6-0aca-4da9-a915-59560f5cb291', 'serial': '788f71f6-0aca-4da9-a915-59560f5cb291'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'numa_topology' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:20 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:34:20 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmCwbdGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:34:20 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:34:20 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:34:20 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a616ec2-ca43-4366-9ef5-4bbbebe7b50d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:34:20 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7a54a1-52be-4266-bb24-ba9b173e97c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291] added
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc4cabc-6f21-4922-ab46-788d02ae07f8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c45a7b6-4237-4011-be9c-eee2e973e2ba]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmCwbdGB {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmCwbdGB" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaa055e-f07f-4d15-bb94-620a40135777]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmCwbdGB'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:20 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Took 1.64 seconds to deallocate network for instance.
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[49be6219-7007-4202-98e5-70fb7d627fd5]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc31240-061e-4de2-8271-55e65a938c71]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0724d3da-cda4-4bb7-b29a-a85706375a29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260]
Jul 27 09:34:20 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260] successful.
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89f9b9d-5520-42b4-8966-8c73ce50d8d2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[df46b320-67ab-4fb2-bc72-afbd110d5297]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:34:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5c9546-a1cb-4eef-9e37-0c19305a49c2]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmCwbdGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:34:20 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:21 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Deleted allocations for instance 2e225354-053f-48f5-ad3f-6662b627d531
Jul 27 09:34:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4782e684-20af-4b61-8e69-28569c5762f0 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "2e225354-053f-48f5-ad3f-6662b627d531" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.882s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26635356331636336', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635356331636336', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'pci_devices' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:34:21 user nova-compute[70374]:   <uuid>25214e8a-c626-46a7-b273-eb491c2fc91b</uuid>
Jul 27 09:34:21 user nova-compute[70374]:   <name>instance-00000006</name>
Jul 27 09:34:21 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:34:21 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:34:21 user nova-compute[70374]:   <metadata>
Jul 27 09:34:21 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:34:21 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:34:21 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeTestJSON-server-1408375692</nova:name>
Jul 27 09:34:21 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:34:20</nova:creationTime>
Jul 27 09:34:21 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:34:21 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:34:21 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:34:21 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:34:21 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:34:21 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:34:21 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:34:21 user nova-compute[70374]:       <nova:owner>
Jul 27 09:34:21 user nova-compute[70374]:         <nova:user uuid="9d4c5ec795ee4d3387ce8718d2ac67e0">tempest-AttachVolumeTestJSON-847846253-project-member</nova:user>
Jul 27 09:34:21 user nova-compute[70374]:         <nova:project uuid="0592f0be670742a181e24823955f378b">tempest-AttachVolumeTestJSON-847846253</nova:project>
Jul 27 09:34:21 user nova-compute[70374]:       </nova:owner>
Jul 27 09:34:21 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:34:21 user nova-compute[70374]:       <nova:ports>
Jul 27 09:34:21 user nova-compute[70374]:         <nova:port uuid="b825d9b4-15c4-4b47-a3f7-af9838d09458">
Jul 27 09:34:21 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 09:34:21 user nova-compute[70374]:         </nova:port>
Jul 27 09:34:21 user nova-compute[70374]:       </nova:ports>
Jul 27 09:34:21 user nova-compute[70374]:     </nova:instance>
Jul 27 09:34:21 user nova-compute[70374]:   </metadata>
Jul 27 09:34:21 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:34:21 user nova-compute[70374]:     <system>
Jul 27 09:34:21 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:34:21 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:34:21 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:34:21 user nova-compute[70374]:       <entry name="serial">25214e8a-c626-46a7-b273-eb491c2fc91b</entry>
Jul 27 09:34:21 user nova-compute[70374]:       <entry name="uuid">25214e8a-c626-46a7-b273-eb491c2fc91b</entry>
Jul 27 09:34:21 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:34:21 user nova-compute[70374]:     </system>
Jul 27 09:34:21 user nova-compute[70374]:   </sysinfo>
Jul 27 09:34:21 user nova-compute[70374]:   <os>
Jul 27 09:34:21 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:34:21 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:34:21 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:34:21 user nova-compute[70374]:   </os>
Jul 27 09:34:21 user nova-compute[70374]:   <features>
Jul 27 09:34:21 user nova-compute[70374]:     <acpi/>
Jul 27 09:34:21 user nova-compute[70374]:     <apic/>
Jul 27 09:34:21 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:34:21 user nova-compute[70374]:   </features>
Jul 27 09:34:21 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:34:21 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:34:21 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:34:21 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:34:21 user nova-compute[70374]:   </clock>
Jul 27 09:34:21 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:34:21 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:34:21 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:34:21 user nova-compute[70374]:   </cpu>
Jul 27 09:34:21 user nova-compute[70374]:   <devices>
Jul 27 09:34:21 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:34:21 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:34:21 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk"/>
Jul 27 09:34:21 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:34:21 user nova-compute[70374]:     </disk>
Jul 27 09:34:21 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:34:21 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:34:21 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 09:34:21 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:34:21 user nova-compute[70374]:       <serial>788f71f6-0aca-4da9-a915-59560f5cb291</serial>
Jul 27 09:34:21 user nova-compute[70374]:     </disk>
Jul 27 09:34:21 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:34:21 user nova-compute[70374]:       <mac address="fa:16:3e:b2:af:a6"/>
Jul 27 09:34:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:34:21 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:34:21 user nova-compute[70374]:       <target dev="tapb825d9b4-15"/>
Jul 27 09:34:21 user nova-compute[70374]:     </interface>
Jul 27 09:34:21 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:34:21 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/console.log" append="off"/>
Jul 27 09:34:21 user nova-compute[70374]:     </serial>
Jul 27 09:34:21 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:34:21 user nova-compute[70374]:     <video>
Jul 27 09:34:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:34:21 user nova-compute[70374]:     </video>
Jul 27 09:34:21 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:34:21 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:34:21 user nova-compute[70374]:     </rng>
Jul 27 09:34:21 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:34:21 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:34:21 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:34:21 user nova-compute[70374]:     </memballoon>
Jul 27 09:34:21 user nova-compute[70374]:   </devices>
Jul 27 09:34:21 user nova-compute[70374]: </domain>
Jul 27 09:34:21 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-4f9197c3-d974-4d9c-adb1-c83d74e7e2c7 req-2568f2ae-ffe0-46ff-a11f-5c5580918d8a service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received event network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4f9197c3-d974-4d9c-adb1-c83d74e7e2c7 req-2568f2ae-ffe0-46ff-a11f-5c5580918d8a service nova] Acquiring lock "2e225354-053f-48f5-ad3f-6662b627d531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4f9197c3-d974-4d9c-adb1-c83d74e7e2c7 req-2568f2ae-ffe0-46ff-a11f-5c5580918d8a service nova] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4f9197c3-d974-4d9c-adb1-c83d74e7e2c7 req-2568f2ae-ffe0-46ff-a11f-5c5580918d8a service nova] Lock "2e225354-053f-48f5-ad3f-6662b627d531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-4f9197c3-d974-4d9c-adb1-c83d74e7e2c7 req-2568f2ae-ffe0-46ff-a11f-5c5580918d8a service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] No waiting events found dispatching network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:34:21 user nova-compute[70374]: WARNING nova.compute.manager [req-4f9197c3-d974-4d9c-adb1-c83d74e7e2c7 req-2568f2ae-ffe0-46ff-a11f-5c5580918d8a service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received unexpected event network-vif-plugged-ddf41035-1805-4fde-b4cf-d86ab3e59c3b for instance with vm_state deleted and task_state None.
Jul 27 09:34:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-4f9197c3-d974-4d9c-adb1-c83d74e7e2c7 req-2568f2ae-ffe0-46ff-a11f-5c5580918d8a service nova] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Received event network-vif-deleted-ddf41035-1805-4fde-b4cf-d86ab3e59c3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG nova.objects.instance [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Cannot resize image /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG nova.objects.instance [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'migration_context' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG os_vif [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb825d9b4-15, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb825d9b4-15, col_values=(('external_ids', {'iface-id': 'b825d9b4-15c4-4b47-a3f7-af9838d09458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:af:a6', 'vm-uuid': '25214e8a-c626-46a7-b273-eb491c2fc91b'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:34:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:22 user nova-compute[70374]: INFO os_vif [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15')
Jul 27 09:34:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-8e05e48c-9534-4967-a6ab-3a42dcaa1435 req-c9b3783c-1680-4098-bc06-5887d24bb48b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8e05e48c-9534-4967-a6ab-3a42dcaa1435 req-c9b3783c-1680-4098-bc06-5887d24bb48b service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8e05e48c-9534-4967-a6ab-3a42dcaa1435 req-c9b3783c-1680-4098-bc06-5887d24bb48b service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8e05e48c-9534-4967-a6ab-3a42dcaa1435 req-c9b3783c-1680-4098-bc06-5887d24bb48b service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-8e05e48c-9534-4967-a6ab-3a42dcaa1435 req-c9b3783c-1680-4098-bc06-5887d24bb48b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:34:24 user nova-compute[70374]: WARNING nova.compute.manager [req-8e05e48c-9534-4967-a6ab-3a42dcaa1435 req-c9b3783c-1680-4098-bc06-5887d24bb48b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state stopped and task_state powering-on.
Jul 27 09:34:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450466.118725, 25214e8a-c626-46a7-b273-eb491c2fc91b => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:34:26 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Resumed (Lifecycle Event)
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:34:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance rebooted successfully.
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-836bcadb-8578-4583-9f0b-7a4d862e564b tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:34:26 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450466.1233253, 25214e8a-c626-46a7-b273-eb491c2fc91b => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:34:26 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Started (Lifecycle Event)
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-b84b4dd3-0a43-43ab-9109-bda5a04d67e4 req-b089b0aa-5113-44cb-a21b-5d9ae7aeedc6 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b84b4dd3-0a43-43ab-9109-bda5a04d67e4 req-b089b0aa-5113-44cb-a21b-5d9ae7aeedc6 service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b84b4dd3-0a43-43ab-9109-bda5a04d67e4 req-b089b0aa-5113-44cb-a21b-5d9ae7aeedc6 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b84b4dd3-0a43-43ab-9109-bda5a04d67e4 req-b089b0aa-5113-44cb-a21b-5d9ae7aeedc6 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-b84b4dd3-0a43-43ab-9109-bda5a04d67e4 req-b089b0aa-5113-44cb-a21b-5d9ae7aeedc6 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:34:26 user nova-compute[70374]: WARNING nova.compute.manager [req-b84b4dd3-0a43-43ab-9109-bda5a04d67e4 req-b089b0aa-5113-44cb-a21b-5d9ae7aeedc6 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state active and task_state None.
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450451.3465054, d35fe056-8279-479a-a673-6c61e5ec6933 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:34:26 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] VM Stopped (Lifecycle Event)
Jul 27 09:34:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-00666396-608c-425b-af76-e6fd650c93c6 None None] [instance: d35fe056-8279-479a-a673-6c61e5ec6933] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:34:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:33 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450458.82465, 2e225354-053f-48f5-ad3f-6662b627d531 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:34:33 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] VM Stopped (Lifecycle Event)
Jul 27 09:34:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-c0e07829-eba1-401d-9c8e-2a35d1f76d37 None None] [instance: 2e225354-053f-48f5-ad3f-6662b627d531] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:34:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:34:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:34:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:34:42 user nova-compute[70374]: INFO nova.compute.claims [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Claim successful on node user
Jul 27 09:34:43 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:34:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:34:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:34:43 user nova-compute[70374]: INFO nova.virt.block_device [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Booting with volume 49c4fb43-a81d-4a19-9a63-1979c093ba09 at /dev/vda
Jul 27 09:34:43 user nova-compute[70374]: DEBUG nova.policy [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76af14c13d204079ba5a25f114be0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4a40f2c025492a908b4624f0815361', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG os_brick.utils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[85be94a7-46d3-4741-96fa-bf5b12de3129]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5149e4f2-258d-4866-9a60-3e5876fde0e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6ddee-af74-434f-a689-d3b4cd4ae9ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbdae72-81ff-4c00-905d-a63e00612396]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:34:43 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:34:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ee7002-cd38-41c9-ad2e-1b4f56c382e2]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG os_brick.utils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:34:43 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating existing volume attachment record: 96c387c1-5cea-43d3-bf54-d68793ac960f {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:34:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:44 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully created port: 373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:34:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully created port: 48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:34:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully created port: ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:34:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully created port: a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:34:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully created port: bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully updated port: 373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-efa6213e-465b-45dd-b57f-86a360db6742 req-b113c87d-b63b-488d-9821-c764849ce7da service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-changed-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-efa6213e-465b-45dd-b57f-86a360db6742 req-b113c87d-b63b-488d-9821-c764849ce7da service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing instance network info cache due to event network-changed-373c1076-c555-4aa8-8adf-68282887852f. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-efa6213e-465b-45dd-b57f-86a360db6742 req-b113c87d-b63b-488d-9821-c764849ce7da service nova] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-efa6213e-465b-45dd-b57f-86a360db6742 req-b113c87d-b63b-488d-9821-c764849ce7da service nova] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG nova.network.neutron [req-efa6213e-465b-45dd-b57f-86a360db6742 req-b113c87d-b63b-488d-9821-c764849ce7da service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing network info cache for port 373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG nova.network.neutron [req-efa6213e-465b-45dd-b57f-86a360db6742 req-b113c87d-b63b-488d-9821-c764849ce7da service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG nova.network.neutron [req-efa6213e-465b-45dd-b57f-86a360db6742 req-b113c87d-b63b-488d-9821-c764849ce7da service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-efa6213e-465b-45dd-b57f-86a360db6742 req-b113c87d-b63b-488d-9821-c764849ce7da service nova] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully updated port: 3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully updated port: 62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-changed-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing instance network info cache due to event network-changed-3c53a5a5-c702-43e3-a2bb-51e1f824344f. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.network.neutron [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing network info cache for port 3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.network.neutron [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.network.neutron [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-changed-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing instance network info cache due to event network-changed-62021705-de1d-4c37-a5ed-74641e747ed9. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:50 user nova-compute[70374]: DEBUG nova.network.neutron [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing network info cache for port 62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:34:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:34:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d400530b-abca-41e7-a366-a44ee098b1d0 req-e1ed8812-3ab3-4cf3-9d1d-1c329c7b6a72 service nova] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully updated port: 48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:34:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully updated port: ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:34:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-changed-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing instance network info cache due to event network-changed-48589c0e-a409-4676-a870-370150852d09. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:34:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing network info cache for port 48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:34:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-changed-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing instance network info cache due to event network-changed-ee552b82-90e3-4ba1-9626-e47306fa9fd6. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing network info cache for port ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6659cb0-30c7-46a2-b64d-47a91dbc3de7 req-6e80ddd6-bd20-4bae-8512-acfd0111efa6 service nova] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully updated port: a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:34:53 user nova-compute[70374]: INFO nova.virt.block_device [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Booting with volume dbe92c73-5715-4f14-b9ef-5e05adf2fc1c at /dev/vdb
Jul 27 09:34:53 user nova-compute[70374]: DEBUG os_brick.utils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1590c009-eaaf-4c87-b49b-ceec3ea19ee7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea966987-3c34-45b8-8263-d706d0d2f715]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0629446e-3ac0-41f7-af47-d4bf2c1f09b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bfb6cc-9624-4e07-bbf3-57c4559b4aa2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:34:53 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:34:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fb2c39-8326-4572-a1f8-8e6b0c92d2dc]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG os_brick.utils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:34:53 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating existing volume attachment record: 2d2f28ec-636b-4f09-b950-1db1bc8f7598 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Successfully updated port: bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-changed-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing instance network info cache due to event network-changed-a7e2d767-58e6-4467-b908-e17fe9b8dd91. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:34:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance network_info: |[{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing network info cache for port a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:57 user nova-compute[70374]: INFO nova.compute.manager [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] instance snapshotting
Jul 27 09:34:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Beginning live snapshot process
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updated VIF entry in instance network info cache for port a7e2d767-58e6-4467-b908-e17fe9b8dd91. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-changed-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing instance network info cache due to event network-changed-bacd440a-9069-47b5-9b37-400d48f9aaed. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing network info cache for port bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:34:57 user nova-compute[70374]: INFO nova.compute.manager [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Rescuing
Jul 27 09:34:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquired lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:34:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json -f qcow2 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json -f qcow2 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json -f qcow2" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk_iirbhl/34c248bbfa654417a84fe664747f564f.delta 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updated VIF entry in instance network info cache for port bacd440a-9069-47b5-9b37-400d48f9aaed. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk_iirbhl/34c248bbfa654417a84fe664747f564f.delta 1073741824" returned: 0 in 0.063s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:58 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d29647c-0ffe-43e4-8755-a826d93b987e req-c560385d-3f16-4d70-98dd-fc536fe5f03e service nova] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG nova.network.neutron [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Releasing lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-1b84cf5d-c809-477f-a147-971b991e5752 req-d2c0e2f4-aaab-4430-a740-2c57f731c4db service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1b84cf5d-c809-477f-a147-971b991e5752 req-d2c0e2f4-aaab-4430-a740-2c57f731c4db service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1b84cf5d-c809-477f-a147-971b991e5752 req-d2c0e2f4-aaab-4430-a740-2c57f731c4db service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1b84cf5d-c809-477f-a147-971b991e5752 req-d2c0e2f4-aaab-4430-a740-2c57f731c4db service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-1b84cf5d-c809-477f-a147-971b991e5752 req-d2c0e2f4-aaab-4430-a740-2c57f731c4db service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:34:59 user nova-compute[70374]: WARNING nova.compute.manager [req-1b84cf5d-c809-477f-a147-971b991e5752 req-d2c0e2f4-aaab-4430-a740-2c57f731c4db service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state active and task_state rescuing.
Jul 27 09:34:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:34:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance destroyed successfully.
Jul 27 09:34:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Attempting rescue
Jul 27 09:34:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70374) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance directory exists: not creating {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 09:34:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Creating image(s)
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:34:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk_iirbhl/34c248bbfa654417a84fe664747f564f.delta /opt/stack/data/nova/instances/snapshots/tmpk_iirbhl/34c248bbfa654417a84fe664747f564f {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.185s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:34:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue" returned: 0 in 0.089s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'migration_context' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Start _get_guest_xml network_info=[{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:57:cb:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '35458adf-261a-4e0b-a4db-b243619b2394', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'resources' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'numa_topology' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2041850193',display_name='tempest-ServerRescueNegativeTestJSON-server-2041850193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2041850193',id=2,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-44a0z2kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:30:29Z,user_data=None,user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=fb5ccac9-1e45-4726-b681-cf34cf3fa521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:57:cb:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:57:cb:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=fd47b104-c8ff-4b76-8f3a-53725f9f318c,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47b104-c8') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'pci_devices' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:35:00 user nova-compute[70374]:   <uuid>fb5ccac9-1e45-4726-b681-cf34cf3fa521</uuid>
Jul 27 09:35:00 user nova-compute[70374]:   <name>instance-00000002</name>
Jul 27 09:35:00 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:35:00 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:35:00 user nova-compute[70374]:   <metadata>
Jul 27 09:35:00 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:35:00 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:35:00 user nova-compute[70374]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2041850193</nova:name>
Jul 27 09:35:00 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:35:00</nova:creationTime>
Jul 27 09:35:00 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:35:00 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:35:00 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:35:00 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:35:00 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:35:00 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:35:00 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:35:00 user nova-compute[70374]:       <nova:owner>
Jul 27 09:35:00 user nova-compute[70374]:         <nova:user uuid="d059c8dff3644f3c9c0c54498a4d78f7">tempest-ServerRescueNegativeTestJSON-241559119-project-member</nova:user>
Jul 27 09:35:00 user nova-compute[70374]:         <nova:project uuid="d8acda82ef3f428fbb93847922a213d1">tempest-ServerRescueNegativeTestJSON-241559119</nova:project>
Jul 27 09:35:00 user nova-compute[70374]:       </nova:owner>
Jul 27 09:35:00 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:35:00 user nova-compute[70374]:       <nova:ports>
Jul 27 09:35:00 user nova-compute[70374]:         <nova:port uuid="fd47b104-c8ff-4b76-8f3a-53725f9f318c">
Jul 27 09:35:00 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 09:35:00 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:00 user nova-compute[70374]:       </nova:ports>
Jul 27 09:35:00 user nova-compute[70374]:     </nova:instance>
Jul 27 09:35:00 user nova-compute[70374]:   </metadata>
Jul 27 09:35:00 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:35:00 user nova-compute[70374]:     <system>
Jul 27 09:35:00 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:35:00 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:35:00 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:35:00 user nova-compute[70374]:       <entry name="serial">fb5ccac9-1e45-4726-b681-cf34cf3fa521</entry>
Jul 27 09:35:00 user nova-compute[70374]:       <entry name="uuid">fb5ccac9-1e45-4726-b681-cf34cf3fa521</entry>
Jul 27 09:35:00 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:35:00 user nova-compute[70374]:     </system>
Jul 27 09:35:00 user nova-compute[70374]:   </sysinfo>
Jul 27 09:35:00 user nova-compute[70374]:   <os>
Jul 27 09:35:00 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:35:00 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:35:00 user nova-compute[70374]:   </os>
Jul 27 09:35:00 user nova-compute[70374]:   <features>
Jul 27 09:35:00 user nova-compute[70374]:     <acpi/>
Jul 27 09:35:00 user nova-compute[70374]:     <apic/>
Jul 27 09:35:00 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:35:00 user nova-compute[70374]:   </features>
Jul 27 09:35:00 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:35:00 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:35:00 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:35:00 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:35:00 user nova-compute[70374]:   </clock>
Jul 27 09:35:00 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:35:00 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:35:00 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:35:00 user nova-compute[70374]:   </cpu>
Jul 27 09:35:00 user nova-compute[70374]:   <devices>
Jul 27 09:35:00 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:35:00 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:35:00 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue"/>
Jul 27 09:35:00 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:35:00 user nova-compute[70374]:     </disk>
Jul 27 09:35:00 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:35:00 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:35:00 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk"/>
Jul 27 09:35:00 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:35:00 user nova-compute[70374]:     </disk>
Jul 27 09:35:00 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:00 user nova-compute[70374]:       <mac address="fa:16:3e:57:cb:7b"/>
Jul 27 09:35:00 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:00 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:00 user nova-compute[70374]:       <target dev="tapfd47b104-c8"/>
Jul 27 09:35:00 user nova-compute[70374]:     </interface>
Jul 27 09:35:00 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:35:00 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/console.log" append="off"/>
Jul 27 09:35:00 user nova-compute[70374]:     </serial>
Jul 27 09:35:00 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:35:00 user nova-compute[70374]:     <video>
Jul 27 09:35:00 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:00 user nova-compute[70374]:     </video>
Jul 27 09:35:00 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:35:00 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:35:00 user nova-compute[70374]:     </rng>
Jul 27 09:35:00 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:35:00 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:35:00 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:35:00 user nova-compute[70374]:     </memballoon>
Jul 27 09:35:00 user nova-compute[70374]:   </devices>
Jul 27 09:35:00 user nova-compute[70374]: </domain>
Jul 27 09:35:00 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:35:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance destroyed successfully.
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No VIF found with MAC fa:16:3e:57:cb:7b, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:35:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk_iirbhl/34c248bbfa654417a84fe664747f564f.delta /opt/stack/data/nova/instances/snapshots/tmpk_iirbhl/34c248bbfa654417a84fe664747f564f" returned: 0 in 0.721s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Snapshot extracted, beginning image upload
Jul 27 09:35:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-1c549a7b-fc08-4dd2-9d20-299cda8509b6 req-3d36c1d7-fdeb-4a45-b7b8-066345adf76c service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1c549a7b-fc08-4dd2-9d20-299cda8509b6 req-3d36c1d7-fdeb-4a45-b7b8-066345adf76c service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1c549a7b-fc08-4dd2-9d20-299cda8509b6 req-3d36c1d7-fdeb-4a45-b7b8-066345adf76c service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1c549a7b-fc08-4dd2-9d20-299cda8509b6 req-3d36c1d7-fdeb-4a45-b7b8-066345adf76c service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-1c549a7b-fc08-4dd2-9d20-299cda8509b6 req-3d36c1d7-fdeb-4a45-b7b8-066345adf76c service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:01 user nova-compute[70374]: WARNING nova.compute.manager [req-1c549a7b-fc08-4dd2-9d20-299cda8509b6 req-3d36c1d7-fdeb-4a45-b7b8-066345adf76c service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state active and task_state rescuing.
Jul 27 09:35:01 user nova-compute[70374]: INFO nova.virt.block_device [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Booting with volume 1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 at /dev/vdc
Jul 27 09:35:02 user nova-compute[70374]: DEBUG os_brick.utils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6922975-4fce-4ce2-95b3-dd75bbf40e17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c6bddb-6fe0-435c-a7d2-3511a969c26a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[933d0fb9-e888-4277-a0e8-913e0204e15b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46bfd7e-45ab-4a42-afe4-fd32a4414832]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:35:02 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:35:02 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[37925a96-a185-4858-a177-a051f6fb0b68]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG os_brick.utils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating existing volume attachment record: b60c1d2f-1101-4ae1-8de8-39fbc72c71b9 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-1441db61-84c7-42b8-81ba-069eefd8b94b req-350b233a-cf1c-4708-8f2f-b87572a0e522 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1441db61-84c7-42b8-81ba-069eefd8b94b req-350b233a-cf1c-4708-8f2f-b87572a0e522 service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1441db61-84c7-42b8-81ba-069eefd8b94b req-350b233a-cf1c-4708-8f2f-b87572a0e522 service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1441db61-84c7-42b8-81ba-069eefd8b94b req-350b233a-cf1c-4708-8f2f-b87572a0e522 service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-1441db61-84c7-42b8-81ba-069eefd8b94b req-350b233a-cf1c-4708-8f2f-b87572a0e522 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:03 user nova-compute[70374]: WARNING nova.compute.manager [req-1441db61-84c7-42b8-81ba-069eefd8b94b req-350b233a-cf1c-4708-8f2f-b87572a0e522 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state active and task_state rescuing.
Jul 27 09:35:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:03 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Snapshot image upload complete
Jul 27 09:35:03 user nova-compute[70374]: INFO nova.compute.manager [None req-6707e58f-45e4-4dde-bc5a-192014520c62 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Took 6.36 seconds to snapshot the instance on the hypervisor.
Jul 27 09:35:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for fb5ccac9-1e45-4726-b681-cf34cf3fa521 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:35:04 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450504.513434, fb5ccac9-1e45-4726-b681-cf34cf3fa521 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:04 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] VM Resumed (Lifecycle Event)
Jul 27 09:35:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d2dca67d-d3bd-4095-b2cf-047e72eae36d tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:04 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 09:35:04 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450504.5195277, fb5ccac9-1e45-4726-b681-cf34cf3fa521 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:04 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] VM Started (Lifecycle Event)
Jul 27 09:35:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-94d2d7b1-72ca-4d39-9276-501d183d0b3e req-9280d5b7-8d14-4521-b4b5-084e7f953ffe service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-94d2d7b1-72ca-4d39-9276-501d183d0b3e req-9280d5b7-8d14-4521-b4b5-084e7f953ffe service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-94d2d7b1-72ca-4d39-9276-501d183d0b3e req-9280d5b7-8d14-4521-b4b5-084e7f953ffe service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-94d2d7b1-72ca-4d39-9276-501d183d0b3e req-9280d5b7-8d14-4521-b4b5-084e7f953ffe service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-94d2d7b1-72ca-4d39-9276-501d183d0b3e req-9280d5b7-8d14-4521-b4b5-084e7f953ffe service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:05 user nova-compute[70374]: WARNING nova.compute.manager [req-94d2d7b1-72ca-4d39-9276-501d183d0b3e req-9280d5b7-8d14-4521-b4b5-084e7f953ffe service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state rescued and task_state None.
Jul 27 09:35:06 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:35:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:06 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updating instance_info_cache with network_info: [{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:35:08 user nova-compute[70374]: INFO nova.compute.claims [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Claim successful on node user
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:08 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.854s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG nova.network.neutron [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:35:09 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:35:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG nova.policy [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa672f231aae45d6a68bddddf583dcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6c645430b147a0983e499772a43790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:35:09 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Creating image(s)
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "/opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "/opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "/opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "71e5091c60895e6350079700df90a189d8f4b8e1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "71e5091c60895e6350079700df90a189d8f4b8e1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.938s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1.part --force-share --output=json" returned: 0 in 0.201s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG nova.virt.images [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] 185aa0ef-3c77-4aec-a94f-f256298ecbcf was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1.part /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Successfully created port: ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:35:10 user nova-compute[70374]: INFO nova.compute.manager [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Detaching volume ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:35:10 user nova-compute[70374]: INFO nova.virt.block_device [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Attempting to driver detach volume ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 from mountpoint /dev/vdb
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1.part /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1.converted" returned: 0 in 0.314s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Attempting to detach device vdb from instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:35:11 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:35:11 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:35:11 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:35:11 user nova-compute[70374]:   <serial>ad9cc86c-1deb-4294-bdbf-5cce1d5b6251</serial>
Jul 27 09:35:11 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:35:11 user nova-compute[70374]: </disk>
Jul 27 09:35:11 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully detached device vdb from instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb from the persistent domain config.
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:35:11 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:35:11 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:35:11 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:35:11 user nova-compute[70374]:   <serial>ad9cc86c-1deb-4294-bdbf-5cce1d5b6251</serial>
Jul 27 09:35:11 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:35:11 user nova-compute[70374]: </disk>
Jul 27 09:35:11 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:35:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Creating image(s)
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Ensure instance console log exists: /opt/stack/data/nova/instances/d7c1bc23-ac7f-430f-908c-c8cad8d92dca/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Start _get_guest_xml network_info=[{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '96c387c1-5cea-43d3-bf54-d68793ac960f', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRmTgBSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca', 'attached_at': '', 'detached_at': '', 'volume_id': '49c4fb43-a81d-4a19-9a63-1979c093ba09', 'serial': '49c4fb43-a81d-4a19-9a63-1979c093ba09'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'device_type': 'disk', 'attachment_id': '2d2f28ec-636b-4f09-b950-1db1bc8f7598', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnYxWwAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbe92c73-5715-4f14-b9ef-5e05adf2fc1c', 'serial': 'dbe92c73-5715-4f14-b9ef-5e05adf2fc1c'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'device_type': 'disk', 'attachment_id': 'b60c1d2f-1101-4ae1-8de8-39fbc72c71b9', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMykDCAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca', 'attached_at': '', 'detached_at': '', 'volume_id': '1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2', 'serial': '1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "71e5091c60895e6350079700df90a189d8f4b8e1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.741s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:11 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRmTgBSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:35:11 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:11 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:11 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1 --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "71e5091c60895e6350079700df90a189d8f4b8e1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "71e5091c60895e6350079700df90a189d8f4b8e1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd7d9fe-8a1a-43ec-b4c9-95f5d7ed2c45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:35:11 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc98c0-c217-4100-ac83-884fa5de484e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09] added
Jul 27 09:35:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ae4d9-479d-4c14-aa7e-d7d826b2a878]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1 --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1,backing_fmt=raw /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de149b1-5e5b-4dd6-b45f-8989d776a0bc]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRmTgBSn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1,backing_fmt=raw /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk 1073741824" returned: 0 in 0.072s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "71e5091c60895e6350079700df90a189d8f4b8e1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRmTgBSn" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbcc987-2c3e-4c22-bcf9-fe7a090ec465]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRmTgBSn'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450511.5718975, 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[07499649-91ba-473c-b33f-5108434ebfdf]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully detached device vdb from instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb from the live domain config.
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWyzhePO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:35:11 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e6c96-1298-4e43-9f46-a38fdd679c61]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1 --force-share --output=json" returned: 0 in 0.187s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'migration_context' on Instance uuid 1aac9621-71fc-4779-bc23-097309302b70 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Ensure instance console log exists: /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc7fde2-01ef-48ae-b92c-b71fa6c4c140]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09, portal: 172.16.0.220,3260]
Jul 27 09:35:11 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09, portal: 172.16.0.220,3260] successful.
Jul 27 09:35:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f64ca-14eb-455b-aeb7-50bcc88f8177]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Successfully updated port: ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquired lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0073cf13-bb85-4e42-98a8-fe1a9efb0899]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:35:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.576s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-09cb414a-c737-4d6f-98c3-5fc8f316ff4b req-5a0381d4-963f-45f5-9765-460897b41512 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-changed-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-09cb414a-c737-4d6f-98c3-5fc8f316ff4b req-5a0381d4-963f-45f5-9765-460897b41512 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Refreshing instance network info cache due to event network-changed-ed00f5b8-e247-4240-8030-6bda2ee3ea4e. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-09cb414a-c737-4d6f-98c3-5fc8f316ff4b req-5a0381d4-963f-45f5-9765-460897b41512 service nova] Acquiring lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c73616-894d-4a6d-a338-92fd7f1f90a6]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRmTgBSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.network.neutron [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updating instance_info_cache with network_info: [{"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Releasing lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Instance network_info: |[{"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-09cb414a-c737-4d6f-98c3-5fc8f316ff4b req-5a0381d4-963f-45f5-9765-460897b41512 service nova] Acquired lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-09cb414a-c737-4d6f-98c3-5fc8f316ff4b req-5a0381d4-963f-45f5-9765-460897b41512 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Refreshing network info cache for port ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Start _get_guest_xml network_info=[{"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='98d8d2a4173a321026d51dd0a600728d',container_format='bare',created_at=2023-07-27T09:34:57Z,direct_url=<?>,disk_format='qcow2',id=185aa0ef-3c77-4aec-a94f-f256298ecbcf,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1280743248',owner='3b6c645430b147a0983e499772a43790',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T09:35:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '185aa0ef-3c77-4aec-a94f-f256298ecbcf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:35:12 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:12 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='98d8d2a4173a321026d51dd0a600728d',container_format='bare',created_at=2023-07-27T09:34:57Z,direct_url=<?>,disk_format='qcow2',id=185aa0ef-3c77-4aec-a94f-f256298ecbcf,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1280743248',owner='3b6c645430b147a0983e499772a43790',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T09:35:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-995130113',display_name='tempest-TestStampPattern-server-995130113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-995130113',id=18,image_ref='185aa0ef-3c77-4aec-a94f-f256298ecbcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj2SFnPDau6vQCtjDQG1ZxRhv34b+wb9sn5YbvH/SZ654hrAREIUSioV28ip+GznAtPzx4FbU600mwPtKiSdblyqS0Oc7MrVQ7evq+7Ird+40EGlZ1xk19BS7xqljznJA==',key_name='tempest-TestStampPattern-355396374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b6c645430b147a0983e499772a43790',ramdisk_id='',reservation_id='r-j39c9vcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ea21f129-1e0a-4ad1-b516-c2a8f92835b7',image_min_disk='1',image_min_ram='0',image_owner_id='3b6c645430b147a0983e499772a43790',image_owner_project_name='tempest-TestStampPattern-795018650',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-795018650-project-member',image_user_id='fa672f231aae45d6a68bddddf583dcde',network_allocated='True',owner_project_name='tempest-TestStampPattern-795018650',owner_user_name='tempest-TestStampPattern-795018650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:35:09Z,user_data=None,user_id='fa672f231aae45d6a68bddddf583dcde',uuid=1aac9621-71fc-4779-bc23-097309302b70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converting VIF {"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:28:16,bridge_name='br-int',has_traffic_filtering=True,id=ed00f5b8-e247-4240-8030-6bda2ee3ea4e,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped00f5b8-e2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aac9621-71fc-4779-bc23-097309302b70 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:35:12 user nova-compute[70374]:   <uuid>1aac9621-71fc-4779-bc23-097309302b70</uuid>
Jul 27 09:35:12 user nova-compute[70374]:   <name>instance-00000012</name>
Jul 27 09:35:12 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:35:12 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:35:12 user nova-compute[70374]:   <metadata>
Jul 27 09:35:12 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:35:12 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:35:12 user nova-compute[70374]:       <nova:name>tempest-TestStampPattern-server-995130113</nova:name>
Jul 27 09:35:12 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:35:12</nova:creationTime>
Jul 27 09:35:12 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:35:12 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:35:12 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:35:12 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:35:12 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:35:12 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:35:12 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:35:12 user nova-compute[70374]:       <nova:owner>
Jul 27 09:35:12 user nova-compute[70374]:         <nova:user uuid="fa672f231aae45d6a68bddddf583dcde">tempest-TestStampPattern-795018650-project-member</nova:user>
Jul 27 09:35:12 user nova-compute[70374]:         <nova:project uuid="3b6c645430b147a0983e499772a43790">tempest-TestStampPattern-795018650</nova:project>
Jul 27 09:35:12 user nova-compute[70374]:       </nova:owner>
Jul 27 09:35:12 user nova-compute[70374]:       <nova:root type="image" uuid="185aa0ef-3c77-4aec-a94f-f256298ecbcf"/>
Jul 27 09:35:12 user nova-compute[70374]:       <nova:ports>
Jul 27 09:35:12 user nova-compute[70374]:         <nova:port uuid="ed00f5b8-e247-4240-8030-6bda2ee3ea4e">
Jul 27 09:35:12 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 09:35:12 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:12 user nova-compute[70374]:       </nova:ports>
Jul 27 09:35:12 user nova-compute[70374]:     </nova:instance>
Jul 27 09:35:12 user nova-compute[70374]:   </metadata>
Jul 27 09:35:12 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:35:12 user nova-compute[70374]:     <system>
Jul 27 09:35:12 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:35:12 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:35:12 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:35:12 user nova-compute[70374]:       <entry name="serial">1aac9621-71fc-4779-bc23-097309302b70</entry>
Jul 27 09:35:12 user nova-compute[70374]:       <entry name="uuid">1aac9621-71fc-4779-bc23-097309302b70</entry>
Jul 27 09:35:12 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:35:12 user nova-compute[70374]:     </system>
Jul 27 09:35:12 user nova-compute[70374]:   </sysinfo>
Jul 27 09:35:12 user nova-compute[70374]:   <os>
Jul 27 09:35:12 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:35:12 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:35:12 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:35:12 user nova-compute[70374]:   </os>
Jul 27 09:35:12 user nova-compute[70374]:   <features>
Jul 27 09:35:12 user nova-compute[70374]:     <acpi/>
Jul 27 09:35:12 user nova-compute[70374]:     <apic/>
Jul 27 09:35:12 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:35:12 user nova-compute[70374]:   </features>
Jul 27 09:35:12 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:35:12 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:35:12 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:35:12 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:35:12 user nova-compute[70374]:   </clock>
Jul 27 09:35:12 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:35:12 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:35:12 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:35:12 user nova-compute[70374]:   </cpu>
Jul 27 09:35:12 user nova-compute[70374]:   <devices>
Jul 27 09:35:12 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:35:12 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:35:12 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk"/>
Jul 27 09:35:12 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:35:12 user nova-compute[70374]:     </disk>
Jul 27 09:35:12 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:12 user nova-compute[70374]:       <mac address="fa:16:3e:8b:28:16"/>
Jul 27 09:35:12 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:12 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:12 user nova-compute[70374]:       <target dev="taped00f5b8-e2"/>
Jul 27 09:35:12 user nova-compute[70374]:     </interface>
Jul 27 09:35:12 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:35:12 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/console.log" append="off"/>
Jul 27 09:35:12 user nova-compute[70374]:     </serial>
Jul 27 09:35:12 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:35:12 user nova-compute[70374]:     <video>
Jul 27 09:35:12 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:12 user nova-compute[70374]:     </video>
Jul 27 09:35:12 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:35:12 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:35:12 user nova-compute[70374]:     </rng>
Jul 27 09:35:12 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:35:12 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:35:12 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:35:12 user nova-compute[70374]:     </memballoon>
Jul 27 09:35:12 user nova-compute[70374]:   </devices>
Jul 27 09:35:12 user nova-compute[70374]: </domain>
Jul 27 09:35:12 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-995130113',display_name='tempest-TestStampPattern-server-995130113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-995130113',id=18,image_ref='185aa0ef-3c77-4aec-a94f-f256298ecbcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj2SFnPDau6vQCtjDQG1ZxRhv34b+wb9sn5YbvH/SZ654hrAREIUSioV28ip+GznAtPzx4FbU600mwPtKiSdblyqS0Oc7MrVQ7evq+7Ird+40EGlZ1xk19BS7xqljznJA==',key_name='tempest-TestStampPattern-355396374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b6c645430b147a0983e499772a43790',ramdisk_id='',reservation_id='r-j39c9vcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ea21f129-1e0a-4ad1-b516-c2a8f92835b7',image_min_disk='1',image_min_ram='0',image_owner_id='3b6c645430b147a0983e499772a43790',image_owner_project_name='tempest-TestStampPattern-795018650',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-795018650-project-member',image_user_id='fa672f231aae45d6a68bddddf583dcde',network_allocated='True',owner_project_name='tempest-TestStampPattern-795018650',owner_user_name='tempest-TestStampPattern-795018650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:35:09Z,user_data=None,user_id='fa672f231aae45d6a68bddddf583dcde',uuid=1aac9621-71fc-4779-bc23-097309302b70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converting VIF {"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:28:16,bridge_name='br-int',has_traffic_filtering=True,id=ed00f5b8-e247-4240-8030-6bda2ee3ea4e,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped00f5b8-e2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG os_vif [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:28:16,bridge_name='br-int',has_traffic_filtering=True,id=ed00f5b8-e247-4240-8030-6bda2ee3ea4e,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped00f5b8-e2') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped00f5b8-e2, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped00f5b8-e2, col_values=(('external_ids', {'iface-id': 'ed00f5b8-e247-4240-8030-6bda2ee3ea4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:28:16', 'vm-uuid': '1aac9621-71fc-4779-bc23-097309302b70'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:12 user nova-compute[70374]: INFO os_vif [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:28:16,bridge_name='br-int',has_traffic_filtering=True,id=ed00f5b8-e247-4240-8030-6bda2ee3ea4e,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped00f5b8-e2')
Jul 27 09:35:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:35:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No VIF found with MAC fa:16:3e:8b:28:16, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.787s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== connect_volume: return (1789ms) {'type': 'block', 'scsi_wwn': '26533303366376338', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533303366376338', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.412s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:13 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7527MB free_disk=25.607864379882812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb6f512-0d5e-46c1-9c06-8c87d571a0cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:35:13 user nova-compute[70374]: No targets found.
Jul 27 09:35:13 user nova-compute[70374]: iSNS:
Jul 27 09:35:13 user nova-compute[70374]: No targets found.
Jul 27 09:35:13 user nova-compute[70374]: STATIC:
Jul 27 09:35:13 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:35:13 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:35:13 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:35:13 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251
Jul 27 09:35:13 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:35:13 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:35:13 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09
Jul 27 09:35:13 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:35:13 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:35:13 user nova-compute[70374]: FIRMWARE:
Jul 27 09:35:13 user nova-compute[70374]: No targets found.
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:35:13 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:35:13 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnYxWwAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:35:13 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc346be-0a5e-4928-81a3-e17e86b6e860]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d28096-cc94-42c7-b1aa-9d69cd933996]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc08c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7ccfc-e298-44ce-a450-69d7809a331e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 42f4c546-47e4-485b-be29-4081c7557bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 30aa3eca-5c9f-443a-af70-461010d4e22e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance e987c251-fdaf-4a37-ad66-9305e529428e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance d7c1bc23-ac7f-430f-908c-c8cad8d92dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 1aac9621-71fc-4779-bc23-097309302b70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.067s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b2307c-352b-4e85-bd07-d502ae7f1aea]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24bf207-b144-4ec6-8ca8-cf4f12fa22b9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dc6381-9021-484c-a4a5-f4b25e84b2fa]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15a4d42-e0ee-4ae8-85a6-7ba7bb5f0589]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.network.neutron [req-09cb414a-c737-4d6f-98c3-5fc8f316ff4b req-5a0381d4-963f-45f5-9765-460897b41512 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updated VIF entry in instance network info cache for port ed00f5b8-e247-4240-8030-6bda2ee3ea4e. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.network.neutron [req-09cb414a-c737-4d6f-98c3-5fc8f316ff4b req-5a0381d4-963f-45f5-9765-460897b41512 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updating instance_info_cache with network_info: [{"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667e587-918f-4be2-96d8-42264958e9b5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251, portal: 172.16.0.220,3260]
Jul 27 09:35:13 user nova-compute[70374]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251, portal: 172.16.0.220,3260] successful.
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-09cb414a-c737-4d6f-98c3-5fc8f316ff4b req-5a0381d4-963f-45f5-9765-460897b41512 service nova] Releasing lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9cc86c-1deb-4294-bdbf-5cce1d5b6251 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ceba4f-c252-4436-bdf7-5c4930de78ff]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== disconnect_volume: return (1824ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.382s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:13 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:13 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[01776f59-432e-47f6-a419-f69a68c69a19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:35:13 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65ddfc9-275a-437a-9695-e228da3e6242]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c] added
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7555ef1c-fb88-431d-b4fa-bcee203bf799]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c6cb6b-b92a-484b-a350-700d4c990751]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnYxWwAy {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnYxWwAy" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d722c40a-7738-487a-981c-ab2b197b46bb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lnYxWwAy'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[156bf89a-05de-40c4-91ce-64ec2ea4f251]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4353f668-ee64-477b-931e-dca724c1c425]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc09858f-ebbd-46e0-be9f-cefc7e6c6329]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c, portal: 172.16.0.220,3260]
Jul 27 09:35:13 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c, portal: 172.16.0.220,3260] successful.
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4054c0-79d7-4423-bda3-4b5f90b48c41]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8012019c-f696-46c6-ac8c-9372673ebe60]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:13 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[89469e88-c4dc-4835-9bf5-d26cab2f5500]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnYxWwAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d09c76e-9b8c-4cf1-8d4c-b4d8ab7610ab req-28ac6d2b-d0c8-4ced-9a6a-b38dbde46036 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d09c76e-9b8c-4cf1-8d4c-b4d8ab7610ab req-28ac6d2b-d0c8-4ced-9a6a-b38dbde46036 service nova] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d09c76e-9b8c-4cf1-8d4c-b4d8ab7610ab req-28ac6d2b-d0c8-4ced-9a6a-b38dbde46036 service nova] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d09c76e-9b8c-4cf1-8d4c-b4d8ab7610ab req-28ac6d2b-d0c8-4ced-9a6a-b38dbde46036 service nova] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d09c76e-9b8c-4cf1-8d4c-b4d8ab7610ab req-28ac6d2b-d0c8-4ced-9a6a-b38dbde46036 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] No waiting events found dispatching network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:14 user nova-compute[70374]: WARNING nova.compute.manager [req-6d09c76e-9b8c-4cf1-8d4c-b4d8ab7610ab req-28ac6d2b-d0c8-4ced-9a6a-b38dbde46036 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received unexpected event network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e for instance with vm_state building and task_state spawning.
Jul 27 09:35:14 user nova-compute[70374]: DEBUG nova.objects.instance [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c7d893fb-0503-4a30-ae54-4850fcef2da3 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.885s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== connect_volume: return (1732ms) {'type': 'block', 'scsi_wwn': '23233373266333866', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233373266333866', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMykDCAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:35:14 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:14 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:14 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bbc07d-f27c-4139-9505-9ad2e2edfd2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:35:14 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd25a7d-c260-4ab0-86d8-8f909e650565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2] added
Jul 27 09:35:14 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d9e5fc-8e03-4a69-ac26-39e5d699e5e6]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8701c223-187d-4fd4-92b5-73c8130dc20c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMykDCAa {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMykDCAa" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26626d8-32b9-4895-b759-241e85eb2212]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XMykDCAa'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb220f0f-6b5b-409e-95f9-01c8b5149206]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae1f7d1-fb6b-4e33-bbac-9f86777811fc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:15 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:15 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c22aead-fcb1-463e-a35c-f34ecf2f5340]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2, portal: 172.16.0.220,3260]
Jul 27 09:35:15 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2, portal: 172.16.0.220,3260] successful.
Jul 27 09:35:15 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[25485049-3da2-4540-b7fe-7bd3f27286f2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[495d0428-2dbc-4ccc-98c9-d7521845b59b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:15 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:35:15 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d01897c-43b6-4844-b2c6-f9572e3b1c2b]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:35:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMykDCAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26338363339366637', 'path': '/dev/sde'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338363339366637', 'path': '/dev/sde'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6d,bridge_name='br-int',has_traffic_filtering=True,id=373c1076-c555-4aa8-8adf-68282887852f,network=Network(b47198de-69ee-48ac-9016-79a939504035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373c1076-c5') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f8:3c,bridge_name='br-int',has_traffic_filtering=True,id=3c53a5a5-c702-43e3-a2bb-51e1f824344f,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c53a5a5-c7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=62021705-de1d-4c37-a5ed-74641e747ed9,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62021705-de') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:f6,bridge_name='br-int',has_traffic_filtering=True,id=48589c0e-a409-4676-a870-370150852d09,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48589c0e-a4') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:94:aa,bridge_name='br-int',has_traffic_filtering=True,id=ee552b82-90e3-4ba1-9626-e47306fa9fd6,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee552b82-90') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:21,bridge_name='br-int',has_traffic_filtering=True,id=a7e2d767-58e6-4467-b908-e17fe9b8dd91,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e2d767-58') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:51:06,bridge_name='br-int',has_traffic_filtering=True,id=bacd440a-9069-47b5-9b37-400d48f9aaed,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacd440a-90') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.objects.instance [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c1bc23-ac7f-430f-908c-c8cad8d92dca {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450516.2836602, 1aac9621-71fc-4779-bc23-097309302b70 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:16 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] VM Resumed (Lifecycle Event)
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.compute.manager [req-b3599141-1fc4-4b36-a1b3-91173b9a0e2e req-d015f48a-3718-4499-b3f6-301c7dcdd698 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b3599141-1fc4-4b36-a1b3-91173b9a0e2e req-d015f48a-3718-4499-b3f6-301c7dcdd698 service nova] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b3599141-1fc4-4b36-a1b3-91173b9a0e2e req-d015f48a-3718-4499-b3f6-301c7dcdd698 service nova] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b3599141-1fc4-4b36-a1b3-91173b9a0e2e req-d015f48a-3718-4499-b3f6-301c7dcdd698 service nova] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.compute.manager [req-b3599141-1fc4-4b36-a1b3-91173b9a0e2e req-d015f48a-3718-4499-b3f6-301c7dcdd698 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] No waiting events found dispatching network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:16 user nova-compute[70374]: WARNING nova.compute.manager [req-b3599141-1fc4-4b36-a1b3-91173b9a0e2e req-d015f48a-3718-4499-b3f6-301c7dcdd698 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received unexpected event network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e for instance with vm_state building and task_state spawning.
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:35:16 user nova-compute[70374]:   <uuid>d7c1bc23-ac7f-430f-908c-c8cad8d92dca</uuid>
Jul 27 09:35:16 user nova-compute[70374]:   <name>instance-00000011</name>
Jul 27 09:35:16 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:35:16 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:35:16 user nova-compute[70374]:   <metadata>
Jul 27 09:35:16 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:35:16 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:35:16 user nova-compute[70374]:       <nova:name>tempest-device-tagging-server-1837052500</nova:name>
Jul 27 09:35:16 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:35:11</nova:creationTime>
Jul 27 09:35:16 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:35:16 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:35:16 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:35:16 user nova-compute[70374]:       <nova:owner>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:user uuid="76af14c13d204079ba5a25f114be0c68">tempest-TaggedBootDevicesTest-1596342635-project-member</nova:user>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:project uuid="cd4a40f2c025492a908b4624f0815361">tempest-TaggedBootDevicesTest-1596342635</nova:project>
Jul 27 09:35:16 user nova-compute[70374]:       </nova:owner>
Jul 27 09:35:16 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:35:16 user nova-compute[70374]:       <nova:ports>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:port uuid="373c1076-c555-4aa8-8adf-68282887852f">
Jul 27 09:35:16 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 09:35:16 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:port uuid="3c53a5a5-c702-43e3-a2bb-51e1f824344f">
Jul 27 09:35:16 user nova-compute[70374]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Jul 27 09:35:16 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:port uuid="62021705-de1d-4c37-a5ed-74641e747ed9">
Jul 27 09:35:16 user nova-compute[70374]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Jul 27 09:35:16 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:port uuid="48589c0e-a409-4676-a870-370150852d09">
Jul 27 09:35:16 user nova-compute[70374]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Jul 27 09:35:16 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:port uuid="ee552b82-90e3-4ba1-9626-e47306fa9fd6">
Jul 27 09:35:16 user nova-compute[70374]:           <nova:ip type="fixed" address="10.1.1.245" ipVersion="4"/>
Jul 27 09:35:16 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:port uuid="a7e2d767-58e6-4467-b908-e17fe9b8dd91">
Jul 27 09:35:16 user nova-compute[70374]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 09:35:16 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:16 user nova-compute[70374]:         <nova:port uuid="bacd440a-9069-47b5-9b37-400d48f9aaed">
Jul 27 09:35:16 user nova-compute[70374]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 09:35:16 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:16 user nova-compute[70374]:       </nova:ports>
Jul 27 09:35:16 user nova-compute[70374]:     </nova:instance>
Jul 27 09:35:16 user nova-compute[70374]:   </metadata>
Jul 27 09:35:16 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:35:16 user nova-compute[70374]:     <system>
Jul 27 09:35:16 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:35:16 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:35:16 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:35:16 user nova-compute[70374]:       <entry name="serial">d7c1bc23-ac7f-430f-908c-c8cad8d92dca</entry>
Jul 27 09:35:16 user nova-compute[70374]:       <entry name="uuid">d7c1bc23-ac7f-430f-908c-c8cad8d92dca</entry>
Jul 27 09:35:16 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:35:16 user nova-compute[70374]:     </system>
Jul 27 09:35:16 user nova-compute[70374]:   </sysinfo>
Jul 27 09:35:16 user nova-compute[70374]:   <os>
Jul 27 09:35:16 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:35:16 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:35:16 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:35:16 user nova-compute[70374]:   </os>
Jul 27 09:35:16 user nova-compute[70374]:   <features>
Jul 27 09:35:16 user nova-compute[70374]:     <acpi/>
Jul 27 09:35:16 user nova-compute[70374]:     <apic/>
Jul 27 09:35:16 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:35:16 user nova-compute[70374]:   </features>
Jul 27 09:35:16 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:35:16 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:35:16 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:35:16 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:35:16 user nova-compute[70374]:   </clock>
Jul 27 09:35:16 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:35:16 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:35:16 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:35:16 user nova-compute[70374]:   </cpu>
Jul 27 09:35:16 user nova-compute[70374]:   <devices>
Jul 27 09:35:16 user nova-compute[70374]:     <disk type="file" device="cdrom">
Jul 27 09:35:16 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 09:35:16 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/d7c1bc23-ac7f-430f-908c-c8cad8d92dca/disk.config"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="hda" bus="ide"/>
Jul 27 09:35:16 user nova-compute[70374]:     </disk>
Jul 27 09:35:16 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:35:16 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:35:16 user nova-compute[70374]:       <source dev="/dev/sdd"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <serial>49c4fb43-a81d-4a19-9a63-1979c093ba09</serial>
Jul 27 09:35:16 user nova-compute[70374]:     </disk>
Jul 27 09:35:16 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:35:16 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:35:16 user nova-compute[70374]:       <source dev="/dev/sdc"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <serial>dbe92c73-5715-4f14-b9ef-5e05adf2fc1c</serial>
Jul 27 09:35:16 user nova-compute[70374]:     </disk>
Jul 27 09:35:16 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:35:16 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:35:16 user nova-compute[70374]:       <source dev="/dev/sde"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="vdc" bus="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <serial>1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2</serial>
Jul 27 09:35:16 user nova-compute[70374]:     </disk>
Jul 27 09:35:16 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:16 user nova-compute[70374]:       <mac address="fa:16:3e:a3:85:6d"/>
Jul 27 09:35:16 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="tap373c1076-c5"/>
Jul 27 09:35:16 user nova-compute[70374]:     </interface>
Jul 27 09:35:16 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:16 user nova-compute[70374]:       <mac address="fa:16:3e:b4:f8:3c"/>
Jul 27 09:35:16 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="tap3c53a5a5-c7"/>
Jul 27 09:35:16 user nova-compute[70374]:     </interface>
Jul 27 09:35:16 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:16 user nova-compute[70374]:       <mac address="fa:16:3e:03:b9:0a"/>
Jul 27 09:35:16 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="tap62021705-de"/>
Jul 27 09:35:16 user nova-compute[70374]:     </interface>
Jul 27 09:35:16 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:16 user nova-compute[70374]:       <mac address="fa:16:3e:76:82:f6"/>
Jul 27 09:35:16 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="tap48589c0e-a4"/>
Jul 27 09:35:16 user nova-compute[70374]:     </interface>
Jul 27 09:35:16 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:16 user nova-compute[70374]:       <mac address="fa:16:3e:47:94:aa"/>
Jul 27 09:35:16 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="tapee552b82-90"/>
Jul 27 09:35:16 user nova-compute[70374]:     </interface>
Jul 27 09:35:16 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:16 user nova-compute[70374]:       <mac address="fa:16:3e:28:9b:21"/>
Jul 27 09:35:16 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="tapa7e2d767-58"/>
Jul 27 09:35:16 user nova-compute[70374]:     </interface>
Jul 27 09:35:16 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:16 user nova-compute[70374]:       <mac address="fa:16:3e:d6:51:06"/>
Jul 27 09:35:16 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:16 user nova-compute[70374]:       <target dev="tapbacd440a-90"/>
Jul 27 09:35:16 user nova-compute[70374]:     </interface>
Jul 27 09:35:16 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:35:16 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/d7c1bc23-ac7f-430f-908c-c8cad8d92dca/console.log" append="off"/>
Jul 27 09:35:16 user nova-compute[70374]:     </serial>
Jul 27 09:35:16 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:35:16 user nova-compute[70374]:     <video>
Jul 27 09:35:16 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:16 user nova-compute[70374]:     </video>
Jul 27 09:35:16 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:35:16 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:35:16 user nova-compute[70374]:     </rng>
Jul 27 09:35:16 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:35:16 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:35:16 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:35:16 user nova-compute[70374]:     </memballoon>
Jul 27 09:35:16 user nova-compute[70374]:   </devices>
Jul 27 09:35:16 user nova-compute[70374]: </domain>
Jul 27 09:35:16 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6d,bridge_name='br-int',has_traffic_filtering=True,id=373c1076-c555-4aa8-8adf-68282887852f,network=Network(b47198de-69ee-48ac-9016-79a939504035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373c1076-c5') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6d,bridge_name='br-int',has_traffic_filtering=True,id=373c1076-c555-4aa8-8adf-68282887852f,network=Network(b47198de-69ee-48ac-9016-79a939504035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373c1076-c5') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:16 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Instance spawned successfully.
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap373c1076-c5, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap373c1076-c5, col_values=(('external_ids', {'iface-id': '373c1076-c555-4aa8-8adf-68282887852f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:85:6d', 'vm-uuid': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: INFO os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6d,bridge_name='br-int',has_traffic_filtering=True,id=373c1076-c555-4aa8-8adf-68282887852f,network=Network(b47198de-69ee-48ac-9016-79a939504035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373c1076-c5')
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f8:3c,bridge_name='br-int',has_traffic_filtering=True,id=3c53a5a5-c702-43e3-a2bb-51e1f824344f,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c53a5a5-c7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f8:3c,bridge_name='br-int',has_traffic_filtering=True,id=3c53a5a5-c702-43e3-a2bb-51e1f824344f,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c53a5a5-c7') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c53a5a5-c7, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c53a5a5-c7, col_values=(('external_ids', {'iface-id': '3c53a5a5-c702-43e3-a2bb-51e1f824344f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:f8:3c', 'vm-uuid': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:16 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450516.2856185, 1aac9621-71fc-4779-bc23-097309302b70 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:16 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] VM Started (Lifecycle Event)
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: INFO os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f8:3c,bridge_name='br-int',has_traffic_filtering=True,id=3c53a5a5-c702-43e3-a2bb-51e1f824344f,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c53a5a5-c7')
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=62021705-de1d-4c37-a5ed-74641e747ed9,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62021705-de') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=62021705-de1d-4c37-a5ed-74641e747ed9,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62021705-de') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62021705-de, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62021705-de, col_values=(('external_ids', {'iface-id': '62021705-de1d-4c37-a5ed-74641e747ed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:b9:0a', 'vm-uuid': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: INFO os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=62021705-de1d-4c37-a5ed-74641e747ed9,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62021705-de')
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:f6,bridge_name='br-int',has_traffic_filtering=True,id=48589c0e-a409-4676-a870-370150852d09,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48589c0e-a4') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:f6,bridge_name='br-int',has_traffic_filtering=True,id=48589c0e-a409-4676-a870-370150852d09,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48589c0e-a4') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48589c0e-a4, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48589c0e-a4, col_values=(('external_ids', {'iface-id': '48589c0e-a409-4676-a870-370150852d09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:82:f6', 'vm-uuid': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:16 user nova-compute[70374]: INFO nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Took 7.15 seconds to spawn the instance on the hypervisor.
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: INFO os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:f6,bridge_name='br-int',has_traffic_filtering=True,id=48589c0e-a409-4676-a870-370150852d09,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48589c0e-a4')
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:94:aa,bridge_name='br-int',has_traffic_filtering=True,id=ee552b82-90e3-4ba1-9626-e47306fa9fd6,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee552b82-90') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:94:aa,bridge_name='br-int',has_traffic_filtering=True,id=ee552b82-90e3-4ba1-9626-e47306fa9fd6,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee552b82-90') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee552b82-90, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee552b82-90, col_values=(('external_ids', {'iface-id': 'ee552b82-90e3-4ba1-9626-e47306fa9fd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:94:aa', 'vm-uuid': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: INFO os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:94:aa,bridge_name='br-int',has_traffic_filtering=True,id=ee552b82-90e3-4ba1-9626-e47306fa9fd6,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee552b82-90')
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:21,bridge_name='br-int',has_traffic_filtering=True,id=a7e2d767-58e6-4467-b908-e17fe9b8dd91,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e2d767-58') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:21,bridge_name='br-int',has_traffic_filtering=True,id=a7e2d767-58e6-4467-b908-e17fe9b8dd91,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e2d767-58') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7e2d767-58, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7e2d767-58, col_values=(('external_ids', {'iface-id': 'a7e2d767-58e6-4467-b908-e17fe9b8dd91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:9b:21', 'vm-uuid': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:16 user nova-compute[70374]: INFO nova.compute.manager [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Took 8.57 seconds to build instance.
Jul 27 09:35:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ebeff60f-cf7c-4fc4-a7fd-bad5d752453d tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.737s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: INFO os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:21,bridge_name='br-int',has_traffic_filtering=True,id=a7e2d767-58e6-4467-b908-e17fe9b8dd91,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e2d767-58')
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:51:06,bridge_name='br-int',has_traffic_filtering=True,id=bacd440a-9069-47b5-9b37-400d48f9aaed,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacd440a-90') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:51:06,bridge_name='br-int',has_traffic_filtering=True,id=bacd440a-9069-47b5-9b37-400d48f9aaed,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacd440a-90') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbacd440a-90, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbacd440a-90, col_values=(('external_ids', {'iface-id': 'bacd440a-9069-47b5-9b37-400d48f9aaed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:51:06', 'vm-uuid': 'd7c1bc23-ac7f-430f-908c-c8cad8d92dca'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:16 user nova-compute[70374]: INFO os_vif [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:51:06,bridge_name='br-int',has_traffic_filtering=True,id=bacd440a-9069-47b5-9b37-400d48f9aaed,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacd440a-90')
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] No BDM found with device name hda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] No VIF found with MAC fa:16:3e:a3:85:6d, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:35:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] No VIF found with MAC fa:16:3e:47:94:aa, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:35:16 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Using config drive
Jul 27 09:35:17 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Creating config drive at /opt/stack/data/nova/instances/d7c1bc23-ac7f-430f-908c-c8cad8d92dca/disk.config
Jul 27 09:35:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d7c1bc23-ac7f-430f-908c-c8cad8d92dca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk_j53gsn {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d7c1bc23-ac7f-430f-908c-c8cad8d92dca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk_j53gsn" returned: 0 in 0.061s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-229da1eb-fd35-489b-a6c1-7370e78f4c23 req-8fd9c1f6-09b3-4067-9fbb-bc393d783a04 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-229da1eb-fd35-489b-a6c1-7370e78f4c23 req-8fd9c1f6-09b3-4067-9fbb-bc393d783a04 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-229da1eb-fd35-489b-a6c1-7370e78f4c23 req-8fd9c1f6-09b3-4067-9fbb-bc393d783a04 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-229da1eb-fd35-489b-a6c1-7370e78f4c23 req-8fd9c1f6-09b3-4067-9fbb-bc393d783a04 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-229da1eb-fd35-489b-a6c1-7370e78f4c23 req-8fd9c1f6-09b3-4067-9fbb-bc393d783a04 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:19 user nova-compute[70374]: WARNING nova.compute.manager [req-229da1eb-fd35-489b-a6c1-7370e78f4c23 req-8fd9c1f6-09b3-4067-9fbb-bc393d783a04 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f for instance with vm_state building and task_state spawning.
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-779658fc-cd10-4037-8317-c3d293c8fade req-48c32d18-2db9-4194-94d6-3ca2882da845 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-779658fc-cd10-4037-8317-c3d293c8fade req-48c32d18-2db9-4194-94d6-3ca2882da845 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-779658fc-cd10-4037-8317-c3d293c8fade req-48c32d18-2db9-4194-94d6-3ca2882da845 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-779658fc-cd10-4037-8317-c3d293c8fade req-48c32d18-2db9-4194-94d6-3ca2882da845 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-779658fc-cd10-4037-8317-c3d293c8fade req-48c32d18-2db9-4194-94d6-3ca2882da845 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:20 user nova-compute[70374]: WARNING nova.compute.manager [req-779658fc-cd10-4037-8317-c3d293c8fade req-48c32d18-2db9-4194-94d6-3ca2882da845 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f for instance with vm_state building and task_state spawning.
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-eff6888b-f3eb-441a-86ef-50fd3d93f246 req-73860816-ee3d-4341-8896-f196ecc97e26 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eff6888b-f3eb-441a-86ef-50fd3d93f246 req-73860816-ee3d-4341-8896-f196ecc97e26 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eff6888b-f3eb-441a-86ef-50fd3d93f246 req-73860816-ee3d-4341-8896-f196ecc97e26 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eff6888b-f3eb-441a-86ef-50fd3d93f246 req-73860816-ee3d-4341-8896-f196ecc97e26 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-eff6888b-f3eb-441a-86ef-50fd3d93f246 req-73860816-ee3d-4341-8896-f196ecc97e26 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:20 user nova-compute[70374]: WARNING nova.compute.manager [req-eff6888b-f3eb-441a-86ef-50fd3d93f246 req-73860816-ee3d-4341-8896-f196ecc97e26 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 for instance with vm_state building and task_state spawning.
Jul 27 09:35:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:21 user nova-compute[70374]: WARNING nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f for instance with vm_state building and task_state spawning.
Jul 27 09:35:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:21 user nova-compute[70374]: WARNING nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 for instance with vm_state building and task_state spawning.
Jul 27 09:35:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:21 user nova-compute[70374]: WARNING nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 for instance with vm_state building and task_state spawning.
Jul 27 09:35:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:21 user nova-compute[70374]: WARNING nova.compute.manager [req-07b70965-10ae-4c60-8394-b2b9e54fbcdd req-a6f80078-dafa-4910-af4e-6818fb249b14 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed for instance with vm_state building and task_state spawning.
Jul 27 09:35:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:22 user nova-compute[70374]: WARNING nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f for instance with vm_state building and task_state spawning.
Jul 27 09:35:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:22 user nova-compute[70374]: WARNING nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 for instance with vm_state building and task_state spawning.
Jul 27 09:35:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:22 user nova-compute[70374]: WARNING nova.compute.manager [req-a05038c3-6c9e-45da-a445-62b93d8c3561 req-91627a8f-b44b-4bdd-aa6d-99084bb5dcdf service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 for instance with vm_state building and task_state spawning.
Jul 27 09:35:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:23 user nova-compute[70374]: WARNING nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 for instance with vm_state building and task_state spawning.
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:23 user nova-compute[70374]: WARNING nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 for instance with vm_state building and task_state spawning.
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:23 user nova-compute[70374]: WARNING nova.compute.manager [req-a80fada9-df5d-44d0-b1b0-6b699f425ebf req-b5eacb1e-7ce9-4679-80bf-4a84022e7624 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 for instance with vm_state building and task_state spawning.
Jul 27 09:35:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450523.7225, d7c1bc23-ac7f-430f-908c-c8cad8d92dca => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] VM Resumed (Lifecycle Event)
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:35:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance spawned successfully.
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450523.7318912, d7c1bc23-ac7f-430f-908c-c8cad8d92dca => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] VM Started (Lifecycle Event)
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:23 user nova-compute[70374]: INFO nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Took 12.83 seconds to spawn the instance on the hypervisor.
Jul 27 09:35:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:24 user nova-compute[70374]: INFO nova.compute.manager [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Took 41.11 seconds to build instance.
Jul 27 09:35:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-74e5dccf-7793-434e-a6d8-caf2a4687f75 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.204s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-c35e16e5-e546-456f-a186-3c7061438767 req-f7d1587f-3692-4108-ab4f-eee6a836f527 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c35e16e5-e546-456f-a186-3c7061438767 req-f7d1587f-3692-4108-ab4f-eee6a836f527 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c35e16e5-e546-456f-a186-3c7061438767 req-f7d1587f-3692-4108-ab4f-eee6a836f527 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c35e16e5-e546-456f-a186-3c7061438767 req-f7d1587f-3692-4108-ab4f-eee6a836f527 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-c35e16e5-e546-456f-a186-3c7061438767 req-f7d1587f-3692-4108-ab4f-eee6a836f527 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:24 user nova-compute[70374]: WARNING nova.compute.manager [req-c35e16e5-e546-456f-a186-3c7061438767 req-f7d1587f-3692-4108-ab4f-eee6a836f527 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed for instance with vm_state active and task_state None.
Jul 27 09:35:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d84b3ac-7b8d-436c-90db-4d1effecc74d req-32db535b-c8cc-425e-914f-26d73d16d54d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received event network-changed-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d84b3ac-7b8d-436c-90db-4d1effecc74d req-32db535b-c8cc-425e-914f-26d73d16d54d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Refreshing instance network info cache due to event network-changed-412b86f3-01b6-4a35-897b-3f886d1444ea. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d84b3ac-7b8d-436c-90db-4d1effecc74d req-32db535b-c8cc-425e-914f-26d73d16d54d service nova] Acquiring lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d84b3ac-7b8d-436c-90db-4d1effecc74d req-32db535b-c8cc-425e-914f-26d73d16d54d service nova] Acquired lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:24 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d84b3ac-7b8d-436c-90db-4d1effecc74d req-32db535b-c8cc-425e-914f-26d73d16d54d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Refreshing network info cache for port 412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:35:25 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d84b3ac-7b8d-436c-90db-4d1effecc74d req-32db535b-c8cc-425e-914f-26d73d16d54d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Updated VIF entry in instance network info cache for port 412b86f3-01b6-4a35-897b-3f886d1444ea. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:35:25 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d84b3ac-7b8d-436c-90db-4d1effecc74d req-32db535b-c8cc-425e-914f-26d73d16d54d service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Updating instance_info_cache with network_info: [{"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d84b3ac-7b8d-436c-90db-4d1effecc74d req-32db535b-c8cc-425e-914f-26d73d16d54d service nova] Releasing lock "refresh_cache-30aa3eca-5c9f-443a-af70-461010d4e22e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:35:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:33 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:35:33 user nova-compute[70374]: INFO nova.compute.claims [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Claim successful on node user
Jul 27 09:35:34 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:35:34 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:35:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:35:34 user nova-compute[70374]: INFO nova.virt.block_device [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Booting with volume 25a4bd30-7c85-4645-88ac-cb52c4883a2b at /dev/vda
Jul 27 09:35:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG os_brick.utils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[500a175a-b6c4-4772-b6f6-b7969d1fd81d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG nova.policy [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b56b56f07f0c4674a09485173c97fd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c072c9f639974ac186a9d8b94baaab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681a2ff-5407-437a-bee4-2a7796c3aea1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8a5862-1bf3-4c48-953f-c37053c80a96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab91afb8-9ecd-4d30-aad7-13dfb58ac076]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:35:34 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:35:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed64aa-0997-4ff7-ab35-909e1e527a8c]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG os_brick.utils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:35:34 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Updating existing volume attachment record: 565650a9-b417-4c5c-92f0-d2399295c3c5 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "e987c251-fdaf-4a37-ad66-9305e529428e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "e987c251-fdaf-4a37-ad66-9305e529428e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:36 user nova-compute[70374]: INFO nova.compute.manager [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Terminating instance
Jul 27 09:35:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:36 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Successfully created port: 6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-70376533-32fc-4c3c-887d-e56ca7fda671 req-ae5d41be-d0e2-4a15-928b-2fa1c110f6fc service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received event network-vif-unplugged-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70376533-32fc-4c3c-887d-e56ca7fda671 req-ae5d41be-d0e2-4a15-928b-2fa1c110f6fc service nova] Acquiring lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70376533-32fc-4c3c-887d-e56ca7fda671 req-ae5d41be-d0e2-4a15-928b-2fa1c110f6fc service nova] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70376533-32fc-4c3c-887d-e56ca7fda671 req-ae5d41be-d0e2-4a15-928b-2fa1c110f6fc service nova] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-70376533-32fc-4c3c-887d-e56ca7fda671 req-ae5d41be-d0e2-4a15-928b-2fa1c110f6fc service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] No waiting events found dispatching network-vif-unplugged-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-70376533-32fc-4c3c-887d-e56ca7fda671 req-ae5d41be-d0e2-4a15-928b-2fa1c110f6fc service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received event network-vif-unplugged-39d6be6a-9951-4831-a632-a151532c0878 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:35:37 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Instance destroyed successfully.
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'resources' on Instance uuid e987c251-fdaf-4a37-ad66-9305e529428e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:33:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-956267581',display_name='tempest-VolumesAdminNegativeTest-server-956267581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-956267581',id=16,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:33:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa3b4d25fdc94c4ea2e148e16478b40c',ramdisk_id='',reservation_id='r-rsfdvwyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1398001736',owner_user_name='tempest-VolumesAdminNegativeTest-1398001736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:33:43Z,user_data=None,user_id='9eecf77414d9472e9e3cd10aec673afb',uuid=e987c251-fdaf-4a37-ad66-9305e529428e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converting VIF {"id": "39d6be6a-9951-4831-a632-a151532c0878", "address": "fa:16:3e:66:0e:b2", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39d6be6a-99", "ovs_interfaceid": "39d6be6a-9951-4831-a632-a151532c0878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:0e:b2,bridge_name='br-int',has_traffic_filtering=True,id=39d6be6a-9951-4831-a632-a151532c0878,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39d6be6a-99') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG os_vif [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:0e:b2,bridge_name='br-int',has_traffic_filtering=True,id=39d6be6a-9951-4831-a632-a151532c0878,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39d6be6a-99') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39d6be6a-99, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:37 user nova-compute[70374]: INFO os_vif [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:0e:b2,bridge_name='br-int',has_traffic_filtering=True,id=39d6be6a-9951-4831-a632-a151532c0878,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39d6be6a-99')
Jul 27 09:35:37 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Deleting instance files /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e_del
Jul 27 09:35:37 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Deletion of /opt/stack/data/nova/instances/e987c251-fdaf-4a37-ad66-9305e529428e_del complete
Jul 27 09:35:37 user nova-compute[70374]: INFO nova.compute.manager [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Took 1.04 seconds to destroy the instance on the hypervisor.
Jul 27 09:35:37 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:35:37 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Successfully updated port: 6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquired lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf697694-f849-4b2e-abef-49f076987b3f req-5ebe61a4-9c53-4f16-a56d-ab0fbdd3f3cd service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-changed-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf697694-f849-4b2e-abef-49f076987b3f req-5ebe61a4-9c53-4f16-a56d-ab0fbdd3f3cd service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Refreshing instance network info cache due to event network-changed-6b853298-921d-44cf-951d-d55fe9364ac3. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf697694-f849-4b2e-abef-49f076987b3f req-5ebe61a4-9c53-4f16-a56d-ab0fbdd3f3cd service nova] Acquiring lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Updating instance_info_cache with network_info: [{"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Releasing lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance network_info: |[{"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf697694-f849-4b2e-abef-49f076987b3f req-5ebe61a4-9c53-4f16-a56d-ab0fbdd3f3cd service nova] Acquired lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG nova.network.neutron [req-bf697694-f849-4b2e-abef-49f076987b3f req-5ebe61a4-9c53-4f16-a56d-ab0fbdd3f3cd service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Refreshing network info cache for port 6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-677d023f-f0d2-40ec-941f-920366b71d79 req-a49a1f5c-5c62-4eac-9ff4-00cf2d288b52 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received event network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-677d023f-f0d2-40ec-941f-920366b71d79 req-a49a1f5c-5c62-4eac-9ff4-00cf2d288b52 service nova] Acquiring lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-677d023f-f0d2-40ec-941f-920366b71d79 req-a49a1f5c-5c62-4eac-9ff4-00cf2d288b52 service nova] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-677d023f-f0d2-40ec-941f-920366b71d79 req-a49a1f5c-5c62-4eac-9ff4-00cf2d288b52 service nova] Lock "e987c251-fdaf-4a37-ad66-9305e529428e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-677d023f-f0d2-40ec-941f-920366b71d79 req-a49a1f5c-5c62-4eac-9ff4-00cf2d288b52 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] No waiting events found dispatching network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:39 user nova-compute[70374]: WARNING nova.compute.manager [req-677d023f-f0d2-40ec-941f-920366b71d79 req-a49a1f5c-5c62-4eac-9ff4-00cf2d288b52 service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received unexpected event network-vif-plugged-39d6be6a-9951-4831-a632-a151532c0878 for instance with vm_state active and task_state deleting.
Jul 27 09:35:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:39 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Took 1.94 seconds to deallocate network for instance.
Jul 27 09:35:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG nova.network.neutron [req-bf697694-f849-4b2e-abef-49f076987b3f req-5ebe61a4-9c53-4f16-a56d-ab0fbdd3f3cd service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Updated VIF entry in instance network info cache for port 6b853298-921d-44cf-951d-d55fe9364ac3. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG nova.network.neutron [req-bf697694-f849-4b2e-abef-49f076987b3f req-5ebe61a4-9c53-4f16-a56d-ab0fbdd3f3cd service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Updating instance_info_cache with network_info: [{"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf697694-f849-4b2e-abef-49f076987b3f req-5ebe61a4-9c53-4f16-a56d-ab0fbdd3f3cd service nova] Releasing lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:40 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:35:40 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:35:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:40 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Deleted allocations for instance e987c251-fdaf-4a37-ad66-9305e529428e
Jul 27 09:35:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1980eccf-c136-40bf-90e7-43b1b68bbf05 tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "e987c251-fdaf-4a37-ad66-9305e529428e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.760s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-8d35ff14-0126-4e71-946e-bf92146afd02 req-f123c2de-1e1c-4f5c-98eb-80fead3037ff service nova] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Received event network-vif-deleted-39d6be6a-9951-4831-a632-a151532c0878 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:35:43 user nova-compute[70374]: INFO nova.compute.claims [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Claim successful on node user
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:35:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Creating image(s)
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Ensure instance console log exists: /opt/stack/data/nova/instances/aba5a5a4-266b-4511-86ee-258843bd41a5/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Start _get_guest_xml network_info=[{"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '565650a9-b417-4c5c-92f0-d2399295c3c5', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aba5a5a4-266b-4511-86ee-258843bd41a5', 'attached_at': '', 'detached_at': '', 'volume_id': '25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'serial': '25a4bd30-7c85-4645-88ac-cb52c4883a2b'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:35:43 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:43 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:35:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:35:43 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9255e681-2c0c-4b1f-8709-da13b61ce61d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:35:43 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c0254d-8ac7-4167-822d-84f814e43ca3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b] added
Jul 27 09:35:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319118d-9e5c-41c4-9ae6-26520b955089]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0318fb1-a363-4395-a262-ceb4df9da3a2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcAVmPHh {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcAVmPHh" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55852d61-d269-44a2-8f00-3bd8de641957]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcAVmPHh'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a1b3f-541e-4eaf-8f2d-1d23773a80c1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[134c5458-ddfe-4342-85f3-0d7be8f0fed9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:43 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:43 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:43 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:35:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:43 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:43 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:43 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:35:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:35:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:35:43 user nova-compute[70374]: DEBUG nova.policy [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f9403033f534073a59cb12f3d02bc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb71f9530b5d43f28bde4f13f2200408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:35:44 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Creating image(s)
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.157s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk 1073741824" returned: 0 in 0.079s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.188s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --login" returned: 0 in 1.079s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d3e75-7024-4578-aebd-813bf3a9f265]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260]
Jul 27 09:35:44 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260] successful.
Jul 27 09:35:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c37712b-2302-433f-bcbe-6e550a21b6c9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf72c3a6-7388-4ded-a175-63f81a37cbc1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:44 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:44 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:44 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:35:44 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:35:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:35:44 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:35:44 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:35:44 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:35:44 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:35:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.423s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Cannot resize image /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'migration_context' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Ensure instance console log exists: /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.031s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd1892e-be00-4b60-a80b-03974de24783]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:35:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Successfully created port: 08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.472s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] <== connect_volume: return (2474ms) {'type': 'block', 'scsi_wwn': '23163396535386466', 'path': '/dev/sdf'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163396535386466', 'path': '/dev/sdf'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1596074640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1596074640',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8G6KrvwXmmOIoccubLX+h6m1EvIBOsR9+vrs/DIs+D3vVzZbUf4UgeHVwvBZKMtROvY8D1A5S38Px3VM0d025CGUjOdGb+pLp/X7j79D5ZGu1WOGNArT636xnxQb1rRw==',key_name='tempest-keypair-828280280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-00d5td73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=aba5a5a4-266b-4511-86ee-258843bd41a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'pci_devices' on Instance uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:35:45 user nova-compute[70374]:   <uuid>aba5a5a4-266b-4511-86ee-258843bd41a5</uuid>
Jul 27 09:35:45 user nova-compute[70374]:   <name>instance-00000013</name>
Jul 27 09:35:45 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:35:45 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:35:45 user nova-compute[70374]:   <metadata>
Jul 27 09:35:45 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:35:45 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:35:45 user nova-compute[70374]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1596074640</nova:name>
Jul 27 09:35:45 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:35:43</nova:creationTime>
Jul 27 09:35:45 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:35:45 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:35:45 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:35:45 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:35:45 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:35:45 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:35:45 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:35:45 user nova-compute[70374]:       <nova:owner>
Jul 27 09:35:45 user nova-compute[70374]:         <nova:user uuid="b56b56f07f0c4674a09485173c97fd4f">tempest-ServerActionsV293TestJSON-405523215-project-member</nova:user>
Jul 27 09:35:45 user nova-compute[70374]:         <nova:project uuid="c072c9f639974ac186a9d8b94baaab20">tempest-ServerActionsV293TestJSON-405523215</nova:project>
Jul 27 09:35:45 user nova-compute[70374]:       </nova:owner>
Jul 27 09:35:45 user nova-compute[70374]:       <nova:ports>
Jul 27 09:35:45 user nova-compute[70374]:         <nova:port uuid="6b853298-921d-44cf-951d-d55fe9364ac3">
Jul 27 09:35:45 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 09:35:45 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:45 user nova-compute[70374]:       </nova:ports>
Jul 27 09:35:45 user nova-compute[70374]:     </nova:instance>
Jul 27 09:35:45 user nova-compute[70374]:   </metadata>
Jul 27 09:35:45 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:35:45 user nova-compute[70374]:     <system>
Jul 27 09:35:45 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:35:45 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:35:45 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:35:45 user nova-compute[70374]:       <entry name="serial">aba5a5a4-266b-4511-86ee-258843bd41a5</entry>
Jul 27 09:35:45 user nova-compute[70374]:       <entry name="uuid">aba5a5a4-266b-4511-86ee-258843bd41a5</entry>
Jul 27 09:35:45 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:35:45 user nova-compute[70374]:     </system>
Jul 27 09:35:45 user nova-compute[70374]:   </sysinfo>
Jul 27 09:35:45 user nova-compute[70374]:   <os>
Jul 27 09:35:45 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:35:45 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:35:45 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:35:45 user nova-compute[70374]:   </os>
Jul 27 09:35:45 user nova-compute[70374]:   <features>
Jul 27 09:35:45 user nova-compute[70374]:     <acpi/>
Jul 27 09:35:45 user nova-compute[70374]:     <apic/>
Jul 27 09:35:45 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:35:45 user nova-compute[70374]:   </features>
Jul 27 09:35:45 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:35:45 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:35:45 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:35:45 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:35:45 user nova-compute[70374]:   </clock>
Jul 27 09:35:45 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:35:45 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:35:45 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:35:45 user nova-compute[70374]:   </cpu>
Jul 27 09:35:45 user nova-compute[70374]:   <devices>
Jul 27 09:35:45 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:35:45 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:35:45 user nova-compute[70374]:       <source dev="/dev/sdf"/>
Jul 27 09:35:45 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:35:45 user nova-compute[70374]:       <serial>25a4bd30-7c85-4645-88ac-cb52c4883a2b</serial>
Jul 27 09:35:45 user nova-compute[70374]:     </disk>
Jul 27 09:35:45 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:45 user nova-compute[70374]:       <mac address="fa:16:3e:16:85:da"/>
Jul 27 09:35:45 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:45 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:45 user nova-compute[70374]:       <target dev="tap6b853298-92"/>
Jul 27 09:35:45 user nova-compute[70374]:     </interface>
Jul 27 09:35:45 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:35:45 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/aba5a5a4-266b-4511-86ee-258843bd41a5/console.log" append="off"/>
Jul 27 09:35:45 user nova-compute[70374]:     </serial>
Jul 27 09:35:45 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:35:45 user nova-compute[70374]:     <video>
Jul 27 09:35:45 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:45 user nova-compute[70374]:     </video>
Jul 27 09:35:45 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:35:45 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:35:45 user nova-compute[70374]:     </rng>
Jul 27 09:35:45 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:35:45 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:35:45 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:35:45 user nova-compute[70374]:     </memballoon>
Jul 27 09:35:45 user nova-compute[70374]:   </devices>
Jul 27 09:35:45 user nova-compute[70374]: </domain>
Jul 27 09:35:45 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1596074640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1596074640',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8G6KrvwXmmOIoccubLX+h6m1EvIBOsR9+vrs/DIs+D3vVzZbUf4UgeHVwvBZKMtROvY8D1A5S38Px3VM0d025CGUjOdGb+pLp/X7j79D5ZGu1WOGNArT636xnxQb1rRw==',key_name='tempest-keypair-828280280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-00d5td73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=aba5a5a4-266b-4511-86ee-258843bd41a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG os_vif [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b853298-92, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b853298-92, col_values=(('external_ids', {'iface-id': '6b853298-921d-44cf-951d-d55fe9364ac3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:85:da', 'vm-uuid': 'aba5a5a4-266b-4511-86ee-258843bd41a5'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:45 user nova-compute[70374]: INFO os_vif [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92')
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] No VIF found with MAC fa:16:3e:16:85:da, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Successfully updated port: 08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquired lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-c801707e-eb05-4e48-81fa-94d80f082f29 req-71975a43-afe9-46fa-8f3f-3bc7591a2048 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-changed-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-c801707e-eb05-4e48-81fa-94d80f082f29 req-71975a43-afe9-46fa-8f3f-3bc7591a2048 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Refreshing instance network info cache due to event network-changed-08a126de-9aff-4def-baa5-0401181a8d3b. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c801707e-eb05-4e48-81fa-94d80f082f29 req-71975a43-afe9-46fa-8f3f-3bc7591a2048 service nova] Acquiring lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Releasing lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance network_info: |[{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c801707e-eb05-4e48-81fa-94d80f082f29 req-71975a43-afe9-46fa-8f3f-3bc7591a2048 service nova] Acquired lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.neutron [req-c801707e-eb05-4e48-81fa-94d80f082f29 req-71975a43-afe9-46fa-8f3f-3bc7591a2048 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Refreshing network info cache for port 08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Start _get_guest_xml network_info=[{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:35:46 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:46 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-5155036',display_name='tempest-ServerStableDeviceRescueTest-server-5155036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-5155036',id=20,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6R6pxyWguYUpGbhXDryFF98r4EErMCAduikmtB8A7jMw32ji5zDskUehPZkgpAo/t9hS38SlQ9OuQGv2/gK7wmIRQk7DqCx9aHpB4MCMzUppNMZq/hdilw2TBZ+Ny5lg==',key_name='tempest-keypair-589835980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb71f9530b5d43f28bde4f13f2200408',ramdisk_id='',reservation_id='r-4qrsflrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1292987631',owner_user_name='tempest-ServerStableDeviceRescueTest-1292987631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f9403033f534073a59cb12f3d02bc91',uuid=69a59942-cd83-4f74-82ea-f23a6538cef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Converting VIF {"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:61:ec,bridge_name='br-int',has_traffic_filtering=True,id=08a126de-9aff-4def-baa5-0401181a8d3b,network=Network(5f60f46f-086a-4008-a28e-a5aee728a59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a126de-9a') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'pci_devices' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:35:46 user nova-compute[70374]:   <uuid>69a59942-cd83-4f74-82ea-f23a6538cef9</uuid>
Jul 27 09:35:46 user nova-compute[70374]:   <name>instance-00000014</name>
Jul 27 09:35:46 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:35:46 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:35:46 user nova-compute[70374]:   <metadata>
Jul 27 09:35:46 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:35:46 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:35:46 user nova-compute[70374]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-5155036</nova:name>
Jul 27 09:35:46 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:35:46</nova:creationTime>
Jul 27 09:35:46 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:35:46 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:35:46 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:35:46 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:35:46 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:35:46 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:35:46 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:35:46 user nova-compute[70374]:       <nova:owner>
Jul 27 09:35:46 user nova-compute[70374]:         <nova:user uuid="1f9403033f534073a59cb12f3d02bc91">tempest-ServerStableDeviceRescueTest-1292987631-project-member</nova:user>
Jul 27 09:35:46 user nova-compute[70374]:         <nova:project uuid="cb71f9530b5d43f28bde4f13f2200408">tempest-ServerStableDeviceRescueTest-1292987631</nova:project>
Jul 27 09:35:46 user nova-compute[70374]:       </nova:owner>
Jul 27 09:35:46 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:35:46 user nova-compute[70374]:       <nova:ports>
Jul 27 09:35:46 user nova-compute[70374]:         <nova:port uuid="08a126de-9aff-4def-baa5-0401181a8d3b">
Jul 27 09:35:46 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 09:35:46 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:46 user nova-compute[70374]:       </nova:ports>
Jul 27 09:35:46 user nova-compute[70374]:     </nova:instance>
Jul 27 09:35:46 user nova-compute[70374]:   </metadata>
Jul 27 09:35:46 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:35:46 user nova-compute[70374]:     <system>
Jul 27 09:35:46 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:35:46 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:35:46 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:35:46 user nova-compute[70374]:       <entry name="serial">69a59942-cd83-4f74-82ea-f23a6538cef9</entry>
Jul 27 09:35:46 user nova-compute[70374]:       <entry name="uuid">69a59942-cd83-4f74-82ea-f23a6538cef9</entry>
Jul 27 09:35:46 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:35:46 user nova-compute[70374]:     </system>
Jul 27 09:35:46 user nova-compute[70374]:   </sysinfo>
Jul 27 09:35:46 user nova-compute[70374]:   <os>
Jul 27 09:35:46 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:35:46 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:35:46 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:35:46 user nova-compute[70374]:   </os>
Jul 27 09:35:46 user nova-compute[70374]:   <features>
Jul 27 09:35:46 user nova-compute[70374]:     <acpi/>
Jul 27 09:35:46 user nova-compute[70374]:     <apic/>
Jul 27 09:35:46 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:35:46 user nova-compute[70374]:   </features>
Jul 27 09:35:46 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:35:46 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:35:46 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:35:46 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:35:46 user nova-compute[70374]:   </clock>
Jul 27 09:35:46 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:35:46 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:35:46 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:35:46 user nova-compute[70374]:   </cpu>
Jul 27 09:35:46 user nova-compute[70374]:   <devices>
Jul 27 09:35:46 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:35:46 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:35:46 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk"/>
Jul 27 09:35:46 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:35:46 user nova-compute[70374]:     </disk>
Jul 27 09:35:46 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:46 user nova-compute[70374]:       <mac address="fa:16:3e:19:61:ec"/>
Jul 27 09:35:46 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:46 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:46 user nova-compute[70374]:       <target dev="tap08a126de-9a"/>
Jul 27 09:35:46 user nova-compute[70374]:     </interface>
Jul 27 09:35:46 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:35:46 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/console.log" append="off"/>
Jul 27 09:35:46 user nova-compute[70374]:     </serial>
Jul 27 09:35:46 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:35:46 user nova-compute[70374]:     <video>
Jul 27 09:35:46 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:46 user nova-compute[70374]:     </video>
Jul 27 09:35:46 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:35:46 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:35:46 user nova-compute[70374]:     </rng>
Jul 27 09:35:46 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:35:46 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:35:46 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:35:46 user nova-compute[70374]:     </memballoon>
Jul 27 09:35:46 user nova-compute[70374]:   </devices>
Jul 27 09:35:46 user nova-compute[70374]: </domain>
Jul 27 09:35:46 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-5155036',display_name='tempest-ServerStableDeviceRescueTest-server-5155036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-5155036',id=20,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6R6pxyWguYUpGbhXDryFF98r4EErMCAduikmtB8A7jMw32ji5zDskUehPZkgpAo/t9hS38SlQ9OuQGv2/gK7wmIRQk7DqCx9aHpB4MCMzUppNMZq/hdilw2TBZ+Ny5lg==',key_name='tempest-keypair-589835980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb71f9530b5d43f28bde4f13f2200408',ramdisk_id='',reservation_id='r-4qrsflrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1292987631',owner_user_name='tempest-ServerStableDeviceRescueTest-1292987631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f9403033f534073a59cb12f3d02bc91',uuid=69a59942-cd83-4f74-82ea-f23a6538cef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Converting VIF {"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:61:ec,bridge_name='br-int',has_traffic_filtering=True,id=08a126de-9aff-4def-baa5-0401181a8d3b,network=Network(5f60f46f-086a-4008-a28e-a5aee728a59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a126de-9a') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG os_vif [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:61:ec,bridge_name='br-int',has_traffic_filtering=True,id=08a126de-9aff-4def-baa5-0401181a8d3b,network=Network(5f60f46f-086a-4008-a28e-a5aee728a59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a126de-9a') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08a126de-9a, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08a126de-9a, col_values=(('external_ids', {'iface-id': '08a126de-9aff-4def-baa5-0401181a8d3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:61:ec', 'vm-uuid': '69a59942-cd83-4f74-82ea-f23a6538cef9'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:46 user nova-compute[70374]: INFO os_vif [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:61:ec,bridge_name='br-int',has_traffic_filtering=True,id=08a126de-9aff-4def-baa5-0401181a8d3b,network=Network(5f60f46f-086a-4008-a28e-a5aee728a59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a126de-9a')
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:35:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No VIF found with MAC fa:16:3e:19:61:ec, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:35:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-c801707e-eb05-4e48-81fa-94d80f082f29 req-71975a43-afe9-46fa-8f3f-3bc7591a2048 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updated VIF entry in instance network info cache for port 08a126de-9aff-4def-baa5-0401181a8d3b. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:35:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-c801707e-eb05-4e48-81fa-94d80f082f29 req-71975a43-afe9-46fa-8f3f-3bc7591a2048 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c801707e-eb05-4e48-81fa-94d80f082f29 req-71975a43-afe9-46fa-8f3f-3bc7591a2048 service nova] Releasing lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-9a335e5d-b931-4156-b26d-39b00aa10f7b req-9f85905f-c2d4-40dd-beed-a2d3bda9b19d service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9a335e5d-b931-4156-b26d-39b00aa10f7b req-9f85905f-c2d4-40dd-beed-a2d3bda9b19d service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9a335e5d-b931-4156-b26d-39b00aa10f7b req-9f85905f-c2d4-40dd-beed-a2d3bda9b19d service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9a335e5d-b931-4156-b26d-39b00aa10f7b req-9f85905f-c2d4-40dd-beed-a2d3bda9b19d service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-9a335e5d-b931-4156-b26d-39b00aa10f7b req-9f85905f-c2d4-40dd-beed-a2d3bda9b19d service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] No waiting events found dispatching network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:48 user nova-compute[70374]: WARNING nova.compute.manager [req-9a335e5d-b931-4156-b26d-39b00aa10f7b req-9f85905f-c2d4-40dd-beed-a2d3bda9b19d service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received unexpected event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 for instance with vm_state building and task_state spawning.
Jul 27 09:35:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-1816830e-bd5d-4944-b7ab-99a6b5c2bbd9 req-790bcb8c-6b69-4af2-be74-1b7d3ff359e6 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1816830e-bd5d-4944-b7ab-99a6b5c2bbd9 req-790bcb8c-6b69-4af2-be74-1b7d3ff359e6 service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1816830e-bd5d-4944-b7ab-99a6b5c2bbd9 req-790bcb8c-6b69-4af2-be74-1b7d3ff359e6 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1816830e-bd5d-4944-b7ab-99a6b5c2bbd9 req-790bcb8c-6b69-4af2-be74-1b7d3ff359e6 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-1816830e-bd5d-4944-b7ab-99a6b5c2bbd9 req-790bcb8c-6b69-4af2-be74-1b7d3ff359e6 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:49 user nova-compute[70374]: WARNING nova.compute.manager [req-1816830e-bd5d-4944-b7ab-99a6b5c2bbd9 req-790bcb8c-6b69-4af2-be74-1b7d3ff359e6 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state building and task_state spawning.
Jul 27 09:35:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-e178289a-4e87-4106-ab74-d8b90218d6b2 req-989170b5-f7e8-42ba-b3e1-145512ae5a1e service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e178289a-4e87-4106-ab74-d8b90218d6b2 req-989170b5-f7e8-42ba-b3e1-145512ae5a1e service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e178289a-4e87-4106-ab74-d8b90218d6b2 req-989170b5-f7e8-42ba-b3e1-145512ae5a1e service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e178289a-4e87-4106-ab74-d8b90218d6b2 req-989170b5-f7e8-42ba-b3e1-145512ae5a1e service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-e178289a-4e87-4106-ab74-d8b90218d6b2 req-989170b5-f7e8-42ba-b3e1-145512ae5a1e service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] No waiting events found dispatching network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:50 user nova-compute[70374]: WARNING nova.compute.manager [req-e178289a-4e87-4106-ab74-d8b90218d6b2 req-989170b5-f7e8-42ba-b3e1-145512ae5a1e service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received unexpected event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 for instance with vm_state building and task_state spawning.
Jul 27 09:35:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:35:50 user nova-compute[70374]: INFO nova.compute.claims [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Claim successful on node user
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450551.3390627, aba5a5a4-266b-4511-86ee-258843bd41a5 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] VM Resumed (Lifecycle Event)
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance spawned successfully.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance spawned successfully.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450551.4623444, aba5a5a4-266b-4511-86ee-258843bd41a5 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] VM Started (Lifecycle Event)
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450551.4747787, 69a59942-cd83-4f74-82ea-f23a6538cef9 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] VM Resumed (Lifecycle Event)
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Took 8.35 seconds to spawn the instance on the hypervisor.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450551.4763596, 69a59942-cd83-4f74-82ea-f23a6538cef9 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] VM Started (Lifecycle Event)
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Took 7.65 seconds to spawn the instance on the hypervisor.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.policy [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dfadf5215e24c45a8f55022e1cda47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856989e8171645fc9a6e6c1cbb2358fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Took 18.26 seconds to build instance.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e75740d-353e-47c6-9a56-dbf2382e81cf req-d7705461-af7b-43c6-8d4f-7d424ecf54a1 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e75740d-353e-47c6-9a56-dbf2382e81cf req-d7705461-af7b-43c6-8d4f-7d424ecf54a1 service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e75740d-353e-47c6-9a56-dbf2382e81cf req-d7705461-af7b-43c6-8d4f-7d424ecf54a1 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e75740d-353e-47c6-9a56-dbf2382e81cf req-d7705461-af7b-43c6-8d4f-7d424ecf54a1 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e75740d-353e-47c6-9a56-dbf2382e81cf req-d7705461-af7b-43c6-8d4f-7d424ecf54a1 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:51 user nova-compute[70374]: WARNING nova.compute.manager [req-5e75740d-353e-47c6-9a56-dbf2382e81cf req-d7705461-af7b-43c6-8d4f-7d424ecf54a1 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state building and task_state spawning.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7efb928-5b22-48a6-bc7a-fbf7bae5b9b2 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.405s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.compute.manager [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Took 8.78 seconds to build instance.
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:35:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Creating image(s)
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "/opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "/opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "/opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1069a090-7bec-4af0-814e-7b9733206ba7 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.919s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk 1073741824" returned: 0 in 0.056s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.173s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450537.3839803, e987c251-fdaf-4a37-ad66-9305e529428e => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:52 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] VM Stopped (Lifecycle Event)
Jul 27 09:35:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a381c9e9-1af6-43db-b8e0-494a5f09a58e None None] [instance: e987c251-fdaf-4a37-ad66-9305e529428e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Successfully created port: c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Cannot resize image /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lazy-loading 'migration_context' on Instance uuid e35e780b-67f2-4617-bbc6-45ee7dc92d96 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Ensure instance console log exists: /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Successfully updated port: c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "refresh_cache-e35e780b-67f2-4617-bbc6-45ee7dc92d96" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquired lock "refresh_cache-e35e780b-67f2-4617-bbc6-45ee7dc92d96" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Updating instance_info_cache with network_info: [{"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Releasing lock "refresh_cache-e35e780b-67f2-4617-bbc6-45ee7dc92d96" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Instance network_info: |[{"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Start _get_guest_xml network_info=[{"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:35:53 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:53 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1352115583',display_name='tempest-VolumesActionsTest-instance-1352115583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1352115583',id=21,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='856989e8171645fc9a6e6c1cbb2358fb',ramdisk_id='',reservation_id='r-fncnz6eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1348517842',owner_user_name='tempest-VolumesActionsTest-1348517842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:35:52Z,user_data=None,user_id='7dfadf5215e24c45a8f55022e1cda47b',uuid=e35e780b-67f2-4617-bbc6-45ee7dc92d96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converting VIF {"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ce:12,bridge_name='br-int',has_traffic_filtering=True,id=c35b1a97-d719-4fbc-b930-4935aeb17c3f,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc35b1a97-d7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.objects.instance [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lazy-loading 'pci_devices' on Instance uuid e35e780b-67f2-4617-bbc6-45ee7dc92d96 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-daa3420f-b04c-451d-8384-50f04ea77c33 req-1c05be43-52f7-46a0-b716-fdca70d590b7 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received event network-changed-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-daa3420f-b04c-451d-8384-50f04ea77c33 req-1c05be43-52f7-46a0-b716-fdca70d590b7 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Refreshing instance network info cache due to event network-changed-c35b1a97-d719-4fbc-b930-4935aeb17c3f. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-daa3420f-b04c-451d-8384-50f04ea77c33 req-1c05be43-52f7-46a0-b716-fdca70d590b7 service nova] Acquiring lock "refresh_cache-e35e780b-67f2-4617-bbc6-45ee7dc92d96" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-daa3420f-b04c-451d-8384-50f04ea77c33 req-1c05be43-52f7-46a0-b716-fdca70d590b7 service nova] Acquired lock "refresh_cache-e35e780b-67f2-4617-bbc6-45ee7dc92d96" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-daa3420f-b04c-451d-8384-50f04ea77c33 req-1c05be43-52f7-46a0-b716-fdca70d590b7 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Refreshing network info cache for port c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:35:53 user nova-compute[70374]:   <uuid>e35e780b-67f2-4617-bbc6-45ee7dc92d96</uuid>
Jul 27 09:35:53 user nova-compute[70374]:   <name>instance-00000015</name>
Jul 27 09:35:53 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:35:53 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:35:53 user nova-compute[70374]:   <metadata>
Jul 27 09:35:53 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:35:53 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:35:53 user nova-compute[70374]:       <nova:name>tempest-VolumesActionsTest-instance-1352115583</nova:name>
Jul 27 09:35:53 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:35:53</nova:creationTime>
Jul 27 09:35:53 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:35:53 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:35:53 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:35:53 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:35:53 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:35:53 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:35:53 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:35:53 user nova-compute[70374]:       <nova:owner>
Jul 27 09:35:53 user nova-compute[70374]:         <nova:user uuid="7dfadf5215e24c45a8f55022e1cda47b">tempest-VolumesActionsTest-1348517842-project-member</nova:user>
Jul 27 09:35:53 user nova-compute[70374]:         <nova:project uuid="856989e8171645fc9a6e6c1cbb2358fb">tempest-VolumesActionsTest-1348517842</nova:project>
Jul 27 09:35:53 user nova-compute[70374]:       </nova:owner>
Jul 27 09:35:53 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:35:53 user nova-compute[70374]:       <nova:ports>
Jul 27 09:35:53 user nova-compute[70374]:         <nova:port uuid="c35b1a97-d719-4fbc-b930-4935aeb17c3f">
Jul 27 09:35:53 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 09:35:53 user nova-compute[70374]:         </nova:port>
Jul 27 09:35:53 user nova-compute[70374]:       </nova:ports>
Jul 27 09:35:53 user nova-compute[70374]:     </nova:instance>
Jul 27 09:35:53 user nova-compute[70374]:   </metadata>
Jul 27 09:35:53 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:35:53 user nova-compute[70374]:     <system>
Jul 27 09:35:53 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:35:53 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:35:53 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:35:53 user nova-compute[70374]:       <entry name="serial">e35e780b-67f2-4617-bbc6-45ee7dc92d96</entry>
Jul 27 09:35:53 user nova-compute[70374]:       <entry name="uuid">e35e780b-67f2-4617-bbc6-45ee7dc92d96</entry>
Jul 27 09:35:53 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:35:53 user nova-compute[70374]:     </system>
Jul 27 09:35:53 user nova-compute[70374]:   </sysinfo>
Jul 27 09:35:53 user nova-compute[70374]:   <os>
Jul 27 09:35:53 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:35:53 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:35:53 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:35:53 user nova-compute[70374]:   </os>
Jul 27 09:35:53 user nova-compute[70374]:   <features>
Jul 27 09:35:53 user nova-compute[70374]:     <acpi/>
Jul 27 09:35:53 user nova-compute[70374]:     <apic/>
Jul 27 09:35:53 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:35:53 user nova-compute[70374]:   </features>
Jul 27 09:35:53 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:35:53 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:35:53 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:35:53 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:35:53 user nova-compute[70374]:   </clock>
Jul 27 09:35:53 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:35:53 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:35:53 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:35:53 user nova-compute[70374]:   </cpu>
Jul 27 09:35:53 user nova-compute[70374]:   <devices>
Jul 27 09:35:53 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:35:53 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:35:53 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk"/>
Jul 27 09:35:53 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:35:53 user nova-compute[70374]:     </disk>
Jul 27 09:35:53 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:35:53 user nova-compute[70374]:       <mac address="fa:16:3e:db:ce:12"/>
Jul 27 09:35:53 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:53 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:35:53 user nova-compute[70374]:       <target dev="tapc35b1a97-d7"/>
Jul 27 09:35:53 user nova-compute[70374]:     </interface>
Jul 27 09:35:53 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:35:53 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/console.log" append="off"/>
Jul 27 09:35:53 user nova-compute[70374]:     </serial>
Jul 27 09:35:53 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:35:53 user nova-compute[70374]:     <video>
Jul 27 09:35:53 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:35:53 user nova-compute[70374]:     </video>
Jul 27 09:35:53 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:35:53 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:35:53 user nova-compute[70374]:     </rng>
Jul 27 09:35:53 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:35:53 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:35:53 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:35:53 user nova-compute[70374]:     </memballoon>
Jul 27 09:35:53 user nova-compute[70374]:   </devices>
Jul 27 09:35:53 user nova-compute[70374]: </domain>
Jul 27 09:35:53 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1352115583',display_name='tempest-VolumesActionsTest-instance-1352115583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1352115583',id=21,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='856989e8171645fc9a6e6c1cbb2358fb',ramdisk_id='',reservation_id='r-fncnz6eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1348517842',owner_user_name='tempest-VolumesActionsTest-1348517842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:35:52Z,user_data=None,user_id='7dfadf5215e24c45a8f55022e1cda47b',uuid=e35e780b-67f2-4617-bbc6-45ee7dc92d96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converting VIF {"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ce:12,bridge_name='br-int',has_traffic_filtering=True,id=c35b1a97-d719-4fbc-b930-4935aeb17c3f,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc35b1a97-d7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG os_vif [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ce:12,bridge_name='br-int',has_traffic_filtering=True,id=c35b1a97-d719-4fbc-b930-4935aeb17c3f,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc35b1a97-d7') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc35b1a97-d7, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc35b1a97-d7, col_values=(('external_ids', {'iface-id': 'c35b1a97-d719-4fbc-b930-4935aeb17c3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:ce:12', 'vm-uuid': 'e35e780b-67f2-4617-bbc6-45ee7dc92d96'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:53 user nova-compute[70374]: INFO os_vif [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ce:12,bridge_name='br-int',has_traffic_filtering=True,id=c35b1a97-d719-4fbc-b930-4935aeb17c3f,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc35b1a97-d7')
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:35:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] No VIF found with MAC fa:16:3e:db:ce:12, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:35:54 user nova-compute[70374]: DEBUG nova.network.neutron [req-daa3420f-b04c-451d-8384-50f04ea77c33 req-1c05be43-52f7-46a0-b716-fdca70d590b7 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Updated VIF entry in instance network info cache for port c35b1a97-d719-4fbc-b930-4935aeb17c3f. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:35:54 user nova-compute[70374]: DEBUG nova.network.neutron [req-daa3420f-b04c-451d-8384-50f04ea77c33 req-1c05be43-52f7-46a0-b716-fdca70d590b7 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Updating instance_info_cache with network_info: [{"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:35:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-daa3420f-b04c-451d-8384-50f04ea77c33 req-1c05be43-52f7-46a0-b716-fdca70d590b7 service nova] Releasing lock "refresh_cache-e35e780b-67f2-4617-bbc6-45ee7dc92d96" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:35:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-dc387c7b-39b4-468e-9250-c4441548b011 req-61abd8b8-0249-4e80-82e2-2a38dfc12a45 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received event network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dc387c7b-39b4-468e-9250-c4441548b011 req-61abd8b8-0249-4e80-82e2-2a38dfc12a45 service nova] Acquiring lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dc387c7b-39b4-468e-9250-c4441548b011 req-61abd8b8-0249-4e80-82e2-2a38dfc12a45 service nova] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dc387c7b-39b4-468e-9250-c4441548b011 req-61abd8b8-0249-4e80-82e2-2a38dfc12a45 service nova] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-dc387c7b-39b4-468e-9250-c4441548b011 req-61abd8b8-0249-4e80-82e2-2a38dfc12a45 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] No waiting events found dispatching network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:55 user nova-compute[70374]: WARNING nova.compute.manager [req-dc387c7b-39b4-468e-9250-c4441548b011 req-61abd8b8-0249-4e80-82e2-2a38dfc12a45 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received unexpected event network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f for instance with vm_state building and task_state spawning.
Jul 27 09:35:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-57e66ad5-acb8-4800-a659-acde04a5356f req-210f9e17-7cc2-4421-87d8-703803699bc6 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received event network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-57e66ad5-acb8-4800-a659-acde04a5356f req-210f9e17-7cc2-4421-87d8-703803699bc6 service nova] Acquiring lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-57e66ad5-acb8-4800-a659-acde04a5356f req-210f9e17-7cc2-4421-87d8-703803699bc6 service nova] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-57e66ad5-acb8-4800-a659-acde04a5356f req-210f9e17-7cc2-4421-87d8-703803699bc6 service nova] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-57e66ad5-acb8-4800-a659-acde04a5356f req-210f9e17-7cc2-4421-87d8-703803699bc6 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] No waiting events found dispatching network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:35:57 user nova-compute[70374]: WARNING nova.compute.manager [req-57e66ad5-acb8-4800-a659-acde04a5356f req-210f9e17-7cc2-4421-87d8-703803699bc6 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received unexpected event network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f for instance with vm_state building and task_state spawning.
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450557.7133672, e35e780b-67f2-4617-bbc6-45ee7dc92d96 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] VM Resumed (Lifecycle Event)
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Instance spawned successfully.
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:35:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450557.7302604, e35e780b-67f2-4617-bbc6-45ee7dc92d96 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:35:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] VM Started (Lifecycle Event)
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:35:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:35:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Took 6.05 seconds to spawn the instance on the hypervisor.
Jul 27 09:35:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:35:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Took 7.09 seconds to build instance.
Jul 27 09:35:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4d11e535-5199-457b-a789-439c0ea74446 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.186s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:35:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:35:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:35:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 09:35:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 09:35:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:00 user nova-compute[70374]: INFO nova.compute.manager [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Terminating instance
Jul 27 09:36:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-07eaaa26-90c1-446c-8480-8946a81a2ae2 req-a8d76e40-a79c-4f91-af37-42e86c973a45 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-unplugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07eaaa26-90c1-446c-8480-8946a81a2ae2 req-a8d76e40-a79c-4f91-af37-42e86c973a45 service nova] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07eaaa26-90c1-446c-8480-8946a81a2ae2 req-a8d76e40-a79c-4f91-af37-42e86c973a45 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-07eaaa26-90c1-446c-8480-8946a81a2ae2 req-a8d76e40-a79c-4f91-af37-42e86c973a45 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-07eaaa26-90c1-446c-8480-8946a81a2ae2 req-a8d76e40-a79c-4f91-af37-42e86c973a45 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] No waiting events found dispatching network-vif-unplugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-07eaaa26-90c1-446c-8480-8946a81a2ae2 req-a8d76e40-a79c-4f91-af37-42e86c973a45 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-unplugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:01 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Instance destroyed successfully.
Jul 27 09:36:01 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'resources' on Instance uuid 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1273462667',display_name='tempest-AttachVolumeNegativeTest-server-1273462667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1273462667',id=5,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGY2O+H9PqW27GcPB7HFQV9b1fArRsb4Q62SdnMok2xNMJx4Ndfl41fCfu4LIuZgNm69n1GAW5tYyT6DlwoIS80yrefNCzUIO8hhqDUSVPM5InUIY/dZEfr1Hu+cJST4A==',key_name='tempest-keypair-1385781482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-ocp00dmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=8640c525-e6ba-4bf8-9fe0-2c08155dd1cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "address": "fa:16:3e:21:44:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dc311e-c8", "ovs_interfaceid": "e6dc311e-c8d0-4b0c-bf42-96919f9d6f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:44:72,bridge_name='br-int',has_traffic_filtering=True,id=e6dc311e-c8d0-4b0c-bf42-96919f9d6f02,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dc311e-c8') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG os_vif [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:44:72,bridge_name='br-int',has_traffic_filtering=True,id=e6dc311e-c8d0-4b0c-bf42-96919f9d6f02,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dc311e-c8') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6dc311e-c8, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:01 user nova-compute[70374]: INFO os_vif [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:44:72,bridge_name='br-int',has_traffic_filtering=True,id=e6dc311e-c8d0-4b0c-bf42-96919f9d6f02,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dc311e-c8')
Jul 27 09:36:01 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Deleting instance files /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb_del
Jul 27 09:36:01 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Deletion of /opt/stack/data/nova/instances/8640c525-e6ba-4bf8-9fe0-2c08155dd1cb_del complete
Jul 27 09:36:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:02 user nova-compute[70374]: INFO nova.compute.manager [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 27 09:36:02 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:02 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Took 0.83 seconds to deallocate network for instance.
Jul 27 09:36:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-787fb838-039a-4d42-a058-79459fe2a74b req-3123081e-45c4-4592-b3a9-8b7fc6895f6c service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-deleted-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] No waiting events found dispatching network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:03 user nova-compute[70374]: WARNING nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received unexpected event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 for instance with vm_state deleted and task_state None.
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] No waiting events found dispatching network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:03 user nova-compute[70374]: WARNING nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received unexpected event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 for instance with vm_state deleted and task_state None.
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] No waiting events found dispatching network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:03 user nova-compute[70374]: WARNING nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received unexpected event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 for instance with vm_state deleted and task_state None.
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-unplugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] No waiting events found dispatching network-vif-unplugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:03 user nova-compute[70374]: WARNING nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received unexpected event network-vif-unplugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 for instance with vm_state deleted and task_state None.
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Acquiring lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] No waiting events found dispatching network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:03 user nova-compute[70374]: WARNING nova.compute.manager [req-812d1df7-a3d5-4f20-83c3-95c24d015160 req-b84e77c9-3863-4b36-bda0-a4eb71419d99 service nova] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Received unexpected event network-vif-plugged-e6dc311e-c8d0-4b0c-bf42-96919f9d6f02 for instance with vm_state deleted and task_state None.
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:03 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Deleted allocations for instance 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb
Jul 27 09:36:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b7465eb2-dff6-4126-995b-685247dcd05d tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "8640c525-e6ba-4bf8-9fe0-2c08155dd1cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.658s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:07 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:36:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:36:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:36:07 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:36:08 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updating instance_info_cache with network_info: [{"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-42f4c546-47e4-485b-be29-4081c7557bad" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:36:08 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:36:08 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:08 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:10 user nova-compute[70374]: INFO nova.compute.manager [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Detaching volume 788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:36:10 user nova-compute[70374]: INFO nova.virt.block_device [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Attempting to driver detach volume 788f71f6-0aca-4da9-a915-59560f5cb291 from mountpoint /dev/vdb
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Attempting to detach device vdb from instance 25214e8a-c626-46a7-b273-eb491c2fc91b from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:36:10 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:36:10 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:36:10 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:36:10 user nova-compute[70374]:   <serial>788f71f6-0aca-4da9-a915-59560f5cb291</serial>
Jul 27 09:36:10 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 09:36:10 user nova-compute[70374]: </disk>
Jul 27 09:36:10 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:36:10 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully detached device vdb from instance 25214e8a-c626-46a7-b273-eb491c2fc91b from the persistent domain config.
Jul 27 09:36:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25214e8a-c626-46a7-b273-eb491c2fc91b from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:36:10 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:36:10 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:36:10 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:36:10 user nova-compute[70374]:   <serial>788f71f6-0aca-4da9-a915-59560f5cb291</serial>
Jul 27 09:36:10 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 09:36:10 user nova-compute[70374]: </disk>
Jul 27 09:36:10 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450571.3017366, 25214e8a-c626-46a7-b273-eb491c2fc91b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:36:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully detached device vdb from instance 25214e8a-c626-46a7-b273-eb491c2fc91b from the live domain config.
Jul 27 09:36:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmCwbdGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:36:11 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd3fceb-6729-4068-b412-a2e440f93422]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:36:11 user nova-compute[70374]: No targets found.
Jul 27 09:36:11 user nova-compute[70374]: iSNS:
Jul 27 09:36:11 user nova-compute[70374]: No targets found.
Jul 27 09:36:11 user nova-compute[70374]: STATIC:
Jul 27 09:36:11 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c
Jul 27 09:36:11 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:11 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:11 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2
Jul 27 09:36:11 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:11 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:11 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291
Jul 27 09:36:11 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:11 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:11 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b
Jul 27 09:36:11 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:11 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:11 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09
Jul 27 09:36:11 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:11 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:11 user nova-compute[70374]: FIRMWARE:
Jul 27 09:36:11 user nova-compute[70374]: No targets found.
Jul 27 09:36:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:36:11 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:36:11 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d07f10-3316-4c51-963a-ed1bda3fb4b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c940b5f-578b-4658-b5ca-8c288bf796d0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:36:11 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:36:11 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:36:11 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:36:11 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:36:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 (non-flash)
Jul 27 09:36:11 user nova-compute[70374]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:36:11 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:36:11 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:36:11 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:36:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28005669e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab3e561-c2f7-426f-ad4c-edfa5cf5567e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6550c9f6-c949-4084-820c-5997cff00a45]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c9053-8b9d-4ead-a9cd-d7e85dd4390c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.091s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e003bf-5e7d-495d-a813-f2bb6dbea64a]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eab3d2-c7cb-4383-a35f-995070a562a5]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0555351b-8754-4b1f-9d09-6c87137e1972]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260]
Jul 27 09:36:11 user nova-compute[70374]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291, portal: 172.16.0.220,3260] successful.
Jul 27 09:36:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788f71f6-0aca-4da9-a915-59560f5cb291 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6881492c-112c-4ecc-af03-e2b3f4e3b4be]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.552s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== disconnect_volume: return (554ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d862928d-9304-4245-a2ba-a2ad858fef6a tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.223s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5c794c9f-8249-4713-abb8-61c41015c2f6 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5c794c9f-8249-4713-abb8-61c41015c2f6 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5c794c9f-8249-4713-abb8-61c41015c2f6 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5c794c9f-8249-4713-abb8-61c41015c2f6 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70374) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG nova.objects.instance [None req-5c794c9f-8249-4713-abb8-61c41015c2f6 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-50983ccb-f972-4384-8f3e-2f3e51e2759e req-e6a27e2d-f724-4bbc-8479-9724daccf7e4 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-50983ccb-f972-4384-8f3e-2f3e51e2759e req-e6a27e2d-f724-4bbc-8479-9724daccf7e4 service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-50983ccb-f972-4384-8f3e-2f3e51e2759e req-e6a27e2d-f724-4bbc-8479-9724daccf7e4 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-50983ccb-f972-4384-8f3e-2f3e51e2759e req-e6a27e2d-f724-4bbc-8479-9724daccf7e4 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-50983ccb-f972-4384-8f3e-2f3e51e2759e req-e6a27e2d-f724-4bbc-8479-9724daccf7e4 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:13 user nova-compute[70374]: WARNING nova.compute.manager [req-50983ccb-f972-4384-8f3e-2f3e51e2759e req-e6a27e2d-f724-4bbc-8479-9724daccf7e4 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state active and task_state powering-off.
Jul 27 09:36:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:14 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance destroyed successfully.
Jul 27 09:36:14 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:36:14 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=6899MB free_disk=25.522659301757812GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5c794c9f-8249-4713-abb8-61c41015c2f6 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5c794c9f-8249-4713-abb8-61c41015c2f6 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.494s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 42f4c546-47e4-485b-be29-4081c7557bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 30aa3eca-5c9f-443a-af70-461010d4e22e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance d7c1bc23-ac7f-430f-908c-c8cad8d92dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 1aac9621-71fc-4779-bc23-097309302b70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance aba5a5a4-266b-4511-86ee-258843bd41a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 69a59942-cd83-4f74-82ea-f23a6538cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance e35e780b-67f2-4617-bbc6-45ee7dc92d96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 09:36:14 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.893s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-56d44394-726c-442d-b30b-1e316a65f5f2 req-4b2362ec-7ee7-4d59-840d-6cf532567b24 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-56d44394-726c-442d-b30b-1e316a65f5f2 req-4b2362ec-7ee7-4d59-840d-6cf532567b24 service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-56d44394-726c-442d-b30b-1e316a65f5f2 req-4b2362ec-7ee7-4d59-840d-6cf532567b24 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-56d44394-726c-442d-b30b-1e316a65f5f2 req-4b2362ec-7ee7-4d59-840d-6cf532567b24 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-56d44394-726c-442d-b30b-1e316a65f5f2 req-4b2362ec-7ee7-4d59-840d-6cf532567b24 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:15 user nova-compute[70374]: WARNING nova.compute.manager [req-56d44394-726c-442d-b30b-1e316a65f5f2 req-4b2362ec-7ee7-4d59-840d-6cf532567b24 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state stopped and task_state None.
Jul 27 09:36:16 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450561.7802763, 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:36:16 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] VM Stopped (Lifecycle Event)
Jul 27 09:36:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fadda7f8-c33b-4e1e-a288-2ae1f894aa14 None None] [instance: 8640c525-e6ba-4bf8-9fe0-2c08155dd1cb] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_power_states {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 04a990b9-ed32-41e9-b384-f0886e8d1b49 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 42f4c546-47e4-485b-be29-4081c7557bad {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid ea21f129-1e0a-4ad1-b516-c2a8f92835b7 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 30aa3eca-5c9f-443a-af70-461010d4e22e {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid d7c1bc23-ac7f-430f-908c-c8cad8d92dca {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 1aac9621-71fc-4779-bc23-097309302b70 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid e35e780b-67f2-4617-bbc6-45ee7dc92d96 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "42f4c546-47e4-485b-be29-4081c7557bad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "30aa3eca-5c9f-443a-af70-461010d4e22e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "1aac9621-71fc-4779-bc23-097309302b70" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "42f4c546-47e4-485b-be29-4081c7557bad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "1aac9621-71fc-4779-bc23-097309302b70" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:29 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450573.9052608, 25214e8a-c626-46a7-b273-eb491c2fc91b => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:36:29 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Stopped (Lifecycle Event)
Jul 27 09:36:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9b6a3dba-2d2c-47e4-bb37-64897531b897 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9b6a3dba-2d2c-47e4-bb37-64897531b897 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:36:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:32 user nova-compute[70374]: INFO nova.compute.manager [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Terminating instance
Jul 27 09:36:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:36:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-32b475cd-9fce-473f-abc4-255a6a1ed866 req-05f82445-fa7b-4dae-861b-ca46bc4f79e7 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received event network-vif-unplugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-32b475cd-9fce-473f-abc4-255a6a1ed866 req-05f82445-fa7b-4dae-861b-ca46bc4f79e7 service nova] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-32b475cd-9fce-473f-abc4-255a6a1ed866 req-05f82445-fa7b-4dae-861b-ca46bc4f79e7 service nova] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-32b475cd-9fce-473f-abc4-255a6a1ed866 req-05f82445-fa7b-4dae-861b-ca46bc4f79e7 service nova] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-32b475cd-9fce-473f-abc4-255a6a1ed866 req-05f82445-fa7b-4dae-861b-ca46bc4f79e7 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] No waiting events found dispatching network-vif-unplugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-32b475cd-9fce-473f-abc4-255a6a1ed866 req-05f82445-fa7b-4dae-861b-ca46bc4f79e7 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received event network-vif-unplugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:33 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Instance destroyed successfully.
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lazy-loading 'resources' on Instance uuid 42f4c546-47e4-485b-be29-4081c7557bad {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1688768109',display_name='tempest-VolumesAdminNegativeTest-server-1688768109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1688768109',id=7,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB50mdHMzOWpotVJV8Hy2B+a9kMnUfx8ncrgXuU5l2s3b2+0s8/IzVYVCK3PIMbOCNWJ+oVutS4E8rj/IvnO7glUGqYpvl5OiKzQBseAPNzkTYHLXKqMWqY/freXFLIXKA==',key_name='tempest-keypair-110342931',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa3b4d25fdc94c4ea2e148e16478b40c',ramdisk_id='',reservation_id='r-xt39zy6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1398001736',owner_user_name='tempest-VolumesAdminNegativeTest-1398001736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9eecf77414d9472e9e3cd10aec673afb',uuid=42f4c546-47e4-485b-be29-4081c7557bad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converting VIF {"id": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "address": "fa:16:3e:bf:c6:71", "network": {"id": "f60fad83-a431-45cc-8f33-49bbd1e52e4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2025296099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa3b4d25fdc94c4ea2e148e16478b40c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9444e6-28", "ovs_interfaceid": "cc9444e6-2840-433c-b7c9-c0df023f6e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c6:71,bridge_name='br-int',has_traffic_filtering=True,id=cc9444e6-2840-433c-b7c9-c0df023f6e43,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9444e6-28') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG os_vif [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c6:71,bridge_name='br-int',has_traffic_filtering=True,id=cc9444e6-2840-433c-b7c9-c0df023f6e43,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9444e6-28') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc9444e6-28, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:33 user nova-compute[70374]: INFO os_vif [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c6:71,bridge_name='br-int',has_traffic_filtering=True,id=cc9444e6-2840-433c-b7c9-c0df023f6e43,network=Network(f60fad83-a431-45cc-8f33-49bbd1e52e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9444e6-28')
Jul 27 09:36:33 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Deleting instance files /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad_del
Jul 27 09:36:33 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Deletion of /opt/stack/data/nova/instances/42f4c546-47e4-485b-be29-4081c7557bad_del complete
Jul 27 09:36:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:33 user nova-compute[70374]: INFO nova.compute.manager [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 09:36:33 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:36:33 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received event network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] Acquiring lock "42f4c546-47e4-485b-be29-4081c7557bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] Lock "42f4c546-47e4-485b-be29-4081c7557bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] No waiting events found dispatching network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:35 user nova-compute[70374]: WARNING nova.compute.manager [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received unexpected event network-vif-plugged-cc9444e6-2840-433c-b7c9-c0df023f6e43 for instance with vm_state active and task_state deleting.
Jul 27 09:36:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-changed-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing instance network info cache due to event network-changed-373c1076-c555-4aa8-8adf-68282887852f. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] Acquiring lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] Acquired lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Refreshing network info cache for port 373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:35 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Took 1.48 seconds to deallocate network for instance.
Jul 27 09:36:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:36:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:35 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Deleted allocations for instance 42f4c546-47e4-485b-be29-4081c7557bad
Jul 27 09:36:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7877a020-2c1d-4333-abb0-4c0c18b57bda tempest-VolumesAdminNegativeTest-1398001736 tempest-VolumesAdminNegativeTest-1398001736-project-member] Lock "42f4c546-47e4-485b-be29-4081c7557bad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.231s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:36 user nova-compute[70374]: DEBUG nova.network.neutron [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updated VIF entry in instance network info cache for port 373c1076-c555-4aa8-8adf-68282887852f. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:36:36 user nova-compute[70374]: DEBUG nova.network.neutron [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c12199ac-0e36-4f0c-86c8-1eb562929ac8 req-154cf9b7-e50f-43de-8e7e-b3115323ed6b service nova] Releasing lock "refresh_cache-d7c1bc23-ac7f-430f-908c-c8cad8d92dca" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:36:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e85fa4f-8ed9-4a93-8439-4c04a368afbf req-ed7a5d49-cc1e-422a-9d5e-2566bf815563 service nova] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Received event network-vif-deleted-cc9444e6-2840-433c-b7c9-c0df023f6e43 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:38 user nova-compute[70374]: INFO nova.compute.manager [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Terminating instance
Jul 27 09:36:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-3512c38f-3946-41c6-b5ab-a8d0d753ede6 req-1796b31e-d9f7-46d6-a799-a035bb4fc859 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3512c38f-3946-41c6-b5ab-a8d0d753ede6 req-1796b31e-d9f7-46d6-a799-a035bb4fc859 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3512c38f-3946-41c6-b5ab-a8d0d753ede6 req-1796b31e-d9f7-46d6-a799-a035bb4fc859 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3512c38f-3946-41c6-b5ab-a8d0d753ede6 req-1796b31e-d9f7-46d6-a799-a035bb4fc859 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-3512c38f-3946-41c6-b5ab-a8d0d753ede6 req-1796b31e-d9f7-46d6-a799-a035bb4fc859 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-unplugged-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-3512c38f-3946-41c6-b5ab-a8d0d753ede6 req-1796b31e-d9f7-46d6-a799-a035bb4fc859 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-373c1076-c555-4aa8-8adf-68282887852f for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-05092fc3-b38a-476d-97e6-8ba77f62a842 req-b0ad5a6c-88a8-4505-bbc8-35cbd29a857f service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-05092fc3-b38a-476d-97e6-8ba77f62a842 req-b0ad5a6c-88a8-4505-bbc8-35cbd29a857f service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-05092fc3-b38a-476d-97e6-8ba77f62a842 req-b0ad5a6c-88a8-4505-bbc8-35cbd29a857f service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-05092fc3-b38a-476d-97e6-8ba77f62a842 req-b0ad5a6c-88a8-4505-bbc8-35cbd29a857f service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-05092fc3-b38a-476d-97e6-8ba77f62a842 req-b0ad5a6c-88a8-4505-bbc8-35cbd29a857f service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-unplugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-05092fc3-b38a-476d-97e6-8ba77f62a842 req-b0ad5a6c-88a8-4505-bbc8-35cbd29a857f service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-unplugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:39 user nova-compute[70374]: WARNING nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-3c53a5a5-c702-43e3-a2bb-51e1f824344f for instance with vm_state active and task_state deleting.
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-unplugged-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-635cf9e1-dae0-4f67-a718-658c937b6c99 req-4db6756e-1684-4ab8-b7fc-01cc8bdc1771 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-62021705-de1d-4c37-a5ed-74641e747ed9 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Instance destroyed successfully.
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.objects.instance [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lazy-loading 'resources' on Instance uuid d7c1bc23-ac7f-430f-908c-c8cad8d92dca {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:85:6d,bridge_name='br-int',has_traffic_filtering=True,id=373c1076-c555-4aa8-8adf-68282887852f,network=Network(b47198de-69ee-48ac-9016-79a939504035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373c1076-c5') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:85:6d,bridge_name='br-int',has_traffic_filtering=True,id=373c1076-c555-4aa8-8adf-68282887852f,network=Network(b47198de-69ee-48ac-9016-79a939504035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373c1076-c5') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap373c1076-c5, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: INFO os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:85:6d,bridge_name='br-int',has_traffic_filtering=True,id=373c1076-c555-4aa8-8adf-68282887852f,network=Network(b47198de-69ee-48ac-9016-79a939504035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373c1076-c5')
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f8:3c,bridge_name='br-int',has_traffic_filtering=True,id=3c53a5a5-c702-43e3-a2bb-51e1f824344f,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c53a5a5-c7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f8:3c,bridge_name='br-int',has_traffic_filtering=True,id=3c53a5a5-c702-43e3-a2bb-51e1f824344f,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c53a5a5-c7') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c53a5a5-c7, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: INFO os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:f8:3c,bridge_name='br-int',has_traffic_filtering=True,id=3c53a5a5-c702-43e3-a2bb-51e1f824344f,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c53a5a5-c7')
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=62021705-de1d-4c37-a5ed-74641e747ed9,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62021705-de') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=62021705-de1d-4c37-a5ed-74641e747ed9,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62021705-de') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62021705-de, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: INFO os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=62021705-de1d-4c37-a5ed-74641e747ed9,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62021705-de')
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:f6,bridge_name='br-int',has_traffic_filtering=True,id=48589c0e-a409-4676-a870-370150852d09,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48589c0e-a4') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:f6,bridge_name='br-int',has_traffic_filtering=True,id=48589c0e-a409-4676-a870-370150852d09,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48589c0e-a4') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48589c0e-a4, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: INFO os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:82:f6,bridge_name='br-int',has_traffic_filtering=True,id=48589c0e-a409-4676-a870-370150852d09,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48589c0e-a4')
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "address": "fa:16:3e:47:94:aa", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee552b82-90", "ovs_interfaceid": "ee552b82-90e3-4ba1-9626-e47306fa9fd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:94:aa,bridge_name='br-int',has_traffic_filtering=True,id=ee552b82-90e3-4ba1-9626-e47306fa9fd6,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee552b82-90') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:94:aa,bridge_name='br-int',has_traffic_filtering=True,id=ee552b82-90e3-4ba1-9626-e47306fa9fd6,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee552b82-90') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee552b82-90, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: INFO os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:94:aa,bridge_name='br-int',has_traffic_filtering=True,id=ee552b82-90e3-4ba1-9626-e47306fa9fd6,network=Network(e50ed927-7059-4784-b189-90a3d6cd16ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee552b82-90')
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:21,bridge_name='br-int',has_traffic_filtering=True,id=a7e2d767-58e6-4467-b908-e17fe9b8dd91,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e2d767-58') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:21,bridge_name='br-int',has_traffic_filtering=True,id=a7e2d767-58e6-4467-b908-e17fe9b8dd91,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e2d767-58') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7e2d767-58, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: INFO os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:21,bridge_name='br-int',has_traffic_filtering=True,id=a7e2d767-58e6-4467-b908-e17fe9b8dd91,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e2d767-58')
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1837052500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1837052500',id=17,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN13pmM2EQ67O6BdHl7rJREA7h53lrPAsT6v6e23Z0S42WYknAyqP+1mxtSE9CoEol3ZGPNlt8l9ciQHiG267ch0Hei4vqN+Z1yCcsNoW37Z5UWykATDVWQCdDSnCMgZg==',key_name='tempest-keypair-2119447813',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd4a40f2c025492a908b4624f0815361',ramdisk_id='',reservation_id='r-ok9n0qhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1596342635',owner_user_name='tempest-TaggedBootDevicesTest-1596342635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76af14c13d204079ba5a25f114be0c68',uuid=d7c1bc23-ac7f-430f-908c-c8cad8d92dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converting VIF {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:51:06,bridge_name='br-int',has_traffic_filtering=True,id=bacd440a-9069-47b5-9b37-400d48f9aaed,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacd440a-90') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:51:06,bridge_name='br-int',has_traffic_filtering=True,id=bacd440a-9069-47b5-9b37-400d48f9aaed,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacd440a-90') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbacd440a-90, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:40 user nova-compute[70374]: INFO os_vif [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:51:06,bridge_name='br-int',has_traffic_filtering=True,id=bacd440a-9069-47b5-9b37-400d48f9aaed,network=Network(188e24e1-e7f3-4522-a459-65649f2571fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacd440a-90')
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRmTgBSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:36:40 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49dbc3-a3e9-4304-be3c-9e061060efab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]: iSNS:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]: STATIC:
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: FIRMWARE:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:36:40 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:36:40 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0de80-0808-4803-ba2d-41eb310af193]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdc8142-0716-47a0-acb7-a5cb4e1675e4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc674ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[132953ed-0ee3-48ae-83bd-9dff1282df9f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e043c638-eca8-42bd-a8cd-dc8a1d55edb9]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d583c-8d8a-4781-b3b9-b50148159ff4]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c43081-b5c1-48b1-a529-93f340c7a5ed]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea6546-1c5b-4b14-9d9c-9f2944cb91d8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f56199-5f65-4534-8327-459d2ddacbe2]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09, portal: 172.16.0.220,3260]
Jul 27 09:36:40 user nova-compute[70374]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09, portal: 172.16.0.220,3260] successful.
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c4fb43-a81d-4a19-9a63-1979c093ba09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f285e7ad-4564-461d-aff6-e2a0bc0a7948]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== disconnect_volume: return (331ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:40 user nova-compute[70374]: WARNING nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-373c1076-c555-4aa8-8adf-68282887852f for instance with vm_state active and task_state deleting.
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-unplugged-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-48589c0e-a409-4676-a870-370150852d09 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:40 user nova-compute[70374]: WARNING nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-48589c0e-a409-4676-a870-370150852d09 for instance with vm_state active and task_state deleting.
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-unplugged-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-bacd440a-9069-47b5-9b37-400d48f9aaed for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:40 user nova-compute[70374]: WARNING nova.compute.manager [req-e53cf024-0290-4d9f-aec4-b99bd007b61e req-a5fe4c47-e9ce-442f-8389-4a120c97e9bb service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-bacd440a-9069-47b5-9b37-400d48f9aaed for instance with vm_state active and task_state deleting.
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnYxWwAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:36:40 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecad42ab-8cac-4c89-b986-3a948b8da637]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]: iSNS:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]: STATIC:
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: FIRMWARE:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:36:40 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:36:40 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3904dd-a81d-422f-8f69-41f87a2f9833]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3220d044-1e30-4397-bfb1-62e41db78c97]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc1b1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4237c0a1-f597-4da3-ad8d-ca303248d0b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[666b5792-3d66-45c6-bf39-217149b5adf9]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3056f4be-2424-4a79-b15b-d8b7def9cc31]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0641ea20-1cf5-446f-98ee-f27dd2ba72fc]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[970741c1-9abe-4d4b-8900-ec94930d4bcb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb77544-f42b-440b-a7c8-79405cca9da7]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c, portal: 172.16.0.220,3260]
Jul 27 09:36:40 user nova-compute[70374]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c, portal: 172.16.0.220,3260] successful.
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe92c73-5715-4f14-b9ef-5e05adf2fc1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8f2cd6-d8d0-4397-b355-eec89633b8ff]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== disconnect_volume: return (275ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMykDCAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:36:40 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[898beebd-e0c4-42c3-85fb-1e4963bfec1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]: iSNS:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]: STATIC:
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b
Jul 27 09:36:40 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:36:40 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:36:40 user nova-compute[70374]: FIRMWARE:
Jul 27 09:36:40 user nova-compute[70374]: No targets found.
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:36:40 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:36:40 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55287ac6-78bb-428d-b5c7-d01de8ed355b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:40 user nova-compute[70374]: WARNING nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-ee552b82-90e3-4ba1-9626-e47306fa9fd6 for instance with vm_state active and task_state deleting.
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-unplugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-unplugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:40 user nova-compute[70374]: WARNING nova.compute.manager [req-c442faf1-231e-47a3-9e0b-42461892a4ab req-d802235a-d7f6-4d48-a7d3-93825aff3021 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-a7e2d767-58e6-4467-b908-e17fe9b8dd91 for instance with vm_state active and task_state deleting.
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[053db15c-7b39-4f60-acf9-11ef631bcaba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 (non-flash)
Jul 27 09:36:40 user nova-compute[70374]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:36:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc15e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2'): ({'sde'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Removing single pathed devices sde {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ca6f7f-ef56-4fad-99ae-8eea65342723]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4ca918-c8e1-45ae-b545-b20c93e74699]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Flushing IO for device /dev/sde {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2bbc9b-c52f-4e39-92e6-0889ba224230]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[83191978-b8ce-43fb-8395-08d016d89c54]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a01bce-bfa5-45fd-9dfb-e4f2461f2115]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3964b8-fabb-47df-8f6a-39288effa11a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2, portal: 172.16.0.220,3260]
Jul 27 09:36:41 user nova-compute[70374]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2, portal: 172.16.0.220,3260] successful.
Jul 27 09:36:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c6a3ca1-0b67-44fc-99f8-2f3ad6c560d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b552a4-6ce7-469d-92d9-1c86a49dd7fd]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] <== disconnect_volume: return (313ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:36:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Deleting instance files /opt/stack/data/nova/instances/d7c1bc23-ac7f-430f-908c-c8cad8d92dca_del
Jul 27 09:36:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Deletion of /opt/stack/data/nova/instances/d7c1bc23-ac7f-430f-908c-c8cad8d92dca_del complete
Jul 27 09:36:41 user nova-compute[70374]: INFO nova.compute.manager [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Took 3.16 seconds to destroy the instance on the hypervisor.
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-cdb2b404-a856-47aa-9f58-17077060b379 req-ada67067-8451-49a8-9b15-b88aa9aa0aa7 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cdb2b404-a856-47aa-9f58-17077060b379 req-ada67067-8451-49a8-9b15-b88aa9aa0aa7 service nova] Acquiring lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cdb2b404-a856-47aa-9f58-17077060b379 req-ada67067-8451-49a8-9b15-b88aa9aa0aa7 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cdb2b404-a856-47aa-9f58-17077060b379 req-ada67067-8451-49a8-9b15-b88aa9aa0aa7 service nova] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-cdb2b404-a856-47aa-9f58-17077060b379 req-ada67067-8451-49a8-9b15-b88aa9aa0aa7 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] No waiting events found dispatching network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:41 user nova-compute[70374]: WARNING nova.compute.manager [req-cdb2b404-a856-47aa-9f58-17077060b379 req-ada67067-8451-49a8-9b15-b88aa9aa0aa7 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received unexpected event network-vif-plugged-62021705-de1d-4c37-a5ed-74641e747ed9 for instance with vm_state active and task_state deleting.
Jul 27 09:36:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-115e5008-3671-427d-9fd0-3de94f5ae523 req-36eef00a-f8e7-4df3-9d61-4606e94bc634 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-deleted-ee552b82-90e3-4ba1-9626-e47306fa9fd6 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:43 user nova-compute[70374]: INFO nova.compute.manager [req-115e5008-3671-427d-9fd0-3de94f5ae523 req-36eef00a-f8e7-4df3-9d61-4606e94bc634 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Neutron deleted interface ee552b82-90e3-4ba1-9626-e47306fa9fd6; detaching it from the instance and deleting it from the info cache
Jul 27 09:36:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-115e5008-3671-427d-9fd0-3de94f5ae523 req-36eef00a-f8e7-4df3-9d61-4606e94bc634 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48589c0e-a409-4676-a870-370150852d09", "address": "fa:16:3e:76:82:f6", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48589c0e-a4", "ovs_interfaceid": "48589c0e-a409-4676-a870-370150852d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-115e5008-3671-427d-9fd0-3de94f5ae523 req-36eef00a-f8e7-4df3-9d61-4606e94bc634 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Detach interface failed, port_id=ee552b82-90e3-4ba1-9626-e47306fa9fd6, reason: Instance d7c1bc23-ac7f-430f-908c-c8cad8d92dca could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:36:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-2ce5ba86-7ccb-4f3d-a8d3-aa7b7d924678 req-3800f19b-c09b-484d-bd23-11476dbc008c service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-deleted-48589c0e-a409-4676-a870-370150852d09 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:45 user nova-compute[70374]: INFO nova.compute.manager [req-2ce5ba86-7ccb-4f3d-a8d3-aa7b7d924678 req-3800f19b-c09b-484d-bd23-11476dbc008c service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Neutron deleted interface 48589c0e-a409-4676-a870-370150852d09; detaching it from the instance and deleting it from the info cache
Jul 27 09:36:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-2ce5ba86-7ccb-4f3d-a8d3-aa7b7d924678 req-3800f19b-c09b-484d-bd23-11476dbc008c service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bacd440a-9069-47b5-9b37-400d48f9aaed", "address": "fa:16:3e:d6:51:06", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacd440a-90", "ovs_interfaceid": "bacd440a-9069-47b5-9b37-400d48f9aaed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-2ce5ba86-7ccb-4f3d-a8d3-aa7b7d924678 req-3800f19b-c09b-484d-bd23-11476dbc008c service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Detach interface failed, port_id=48589c0e-a409-4676-a870-370150852d09, reason: Instance d7c1bc23-ac7f-430f-908c-c8cad8d92dca could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:36:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-2ce5ba86-7ccb-4f3d-a8d3-aa7b7d924678 req-3800f19b-c09b-484d-bd23-11476dbc008c service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-deleted-bacd440a-9069-47b5-9b37-400d48f9aaed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:45 user nova-compute[70374]: INFO nova.compute.manager [req-2ce5ba86-7ccb-4f3d-a8d3-aa7b7d924678 req-3800f19b-c09b-484d-bd23-11476dbc008c service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Neutron deleted interface bacd440a-9069-47b5-9b37-400d48f9aaed; detaching it from the instance and deleting it from the info cache
Jul 27 09:36:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-2ce5ba86-7ccb-4f3d-a8d3-aa7b7d924678 req-3800f19b-c09b-484d-bd23-11476dbc008c service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [{"id": "373c1076-c555-4aa8-8adf-68282887852f", "address": "fa:16:3e:a3:85:6d", "network": {"id": "b47198de-69ee-48ac-9016-79a939504035", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-743487914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373c1076-c5", "ovs_interfaceid": "373c1076-c555-4aa8-8adf-68282887852f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "address": "fa:16:3e:b4:f8:3c", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53a5a5-c7", "ovs_interfaceid": "3c53a5a5-c702-43e3-a2bb-51e1f824344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62021705-de1d-4c37-a5ed-74641e747ed9", "address": "fa:16:3e:03:b9:0a", "network": {"id": "e50ed927-7059-4784-b189-90a3d6cd16ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-2050609797", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62021705-de", "ovs_interfaceid": "62021705-de1d-4c37-a5ed-74641e747ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "address": "fa:16:3e:28:9b:21", "network": {"id": "188e24e1-e7f3-4522-a459-65649f2571fb", "bridge": "br-int", "label": "tempest-device-tagging-net2-21467019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd4a40f2c025492a908b4624f0815361", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e2d767-58", "ovs_interfaceid": "a7e2d767-58e6-4467-b908-e17fe9b8dd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-2ce5ba86-7ccb-4f3d-a8d3-aa7b7d924678 req-3800f19b-c09b-484d-bd23-11476dbc008c service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Detach interface failed, port_id=bacd440a-9069-47b5-9b37-400d48f9aaed, reason: Instance d7c1bc23-ac7f-430f-908c-c8cad8d92dca could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:36:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:45 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:45 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Took 4.34 seconds to deallocate network for instance.
Jul 27 09:36:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-ce73d0df-f8ca-4a04-83b0-f9961006aada req-285bd21b-8556-4dce-86e3-e02934677393 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-deleted-373c1076-c555-4aa8-8adf-68282887852f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-ce73d0df-f8ca-4a04-83b0-f9961006aada req-285bd21b-8556-4dce-86e3-e02934677393 service nova] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Received event network-vif-deleted-a7e2d767-58e6-4467-b908-e17fe9b8dd91 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:47 user nova-compute[70374]: INFO nova.compute.manager [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Took 2.27 seconds to detach 3 volumes for instance.
Jul 27 09:36:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:48 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:36:48 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:36:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:48 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Deleted allocations for instance d7c1bc23-ac7f-430f-908c-c8cad8d92dca
Jul 27 09:36:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56e75088-c78c-4bca-aef3-eb5780fc8931 tempest-TaggedBootDevicesTest-1596342635 tempest-TaggedBootDevicesTest-1596342635-project-member] Lock "d7c1bc23-ac7f-430f-908c-c8cad8d92dca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.317s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:48 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450593.6170619, 42f4c546-47e4-485b-be29-4081c7557bad => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:36:48 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] VM Stopped (Lifecycle Event)
Jul 27 09:36:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-46667651-7e79-447e-bff7-adbd0f794367 None None] [instance: 42f4c546-47e4-485b-be29-4081c7557bad] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:49 user nova-compute[70374]: INFO nova.compute.manager [None req-cef78201-b5be-4889-a2cf-bddb21e706c3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Unrescuing
Jul 27 09:36:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cef78201-b5be-4889-a2cf-bddb21e706c3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cef78201-b5be-4889-a2cf-bddb21e706c3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquired lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-cef78201-b5be-4889-a2cf-bddb21e706c3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-cef78201-b5be-4889-a2cf-bddb21e706c3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cef78201-b5be-4889-a2cf-bddb21e706c3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Releasing lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-cef78201-b5be-4889-a2cf-bddb21e706c3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'flavor' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-21e87914-f7e4-4a36-bc7b-5f0df7b903e4 req-8be78e05-fdd1-4f21-955b-7fd66355fd20 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-21e87914-f7e4-4a36-bc7b-5f0df7b903e4 req-8be78e05-fdd1-4f21-955b-7fd66355fd20 service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-21e87914-f7e4-4a36-bc7b-5f0df7b903e4 req-8be78e05-fdd1-4f21-955b-7fd66355fd20 service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-21e87914-f7e4-4a36-bc7b-5f0df7b903e4 req-8be78e05-fdd1-4f21-955b-7fd66355fd20 service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-21e87914-f7e4-4a36-bc7b-5f0df7b903e4 req-8be78e05-fdd1-4f21-955b-7fd66355fd20 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:49 user nova-compute[70374]: WARNING nova.compute.manager [req-21e87914-f7e4-4a36-bc7b-5f0df7b903e4 req-8be78e05-fdd1-4f21-955b-7fd66355fd20 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:36:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:50 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance destroyed successfully.
Jul 27 09:36:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:52 user nova-compute[70374]: WARNING nova.compute.manager [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:36:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:52 user nova-compute[70374]: WARNING nova.compute.manager [req-e9ca3180-9a33-4fe0-95cf-41e99ee559cf req-51f2b9f5-185f-4bff-ac15-1e06e216b22a service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:36:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for fb5ccac9-1e45-4726-b681-cf34cf3fa521 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:36:53 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450613.8248532, fb5ccac9-1e45-4726-b681-cf34cf3fa521 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:36:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] VM Resumed (Lifecycle Event)
Jul 27 09:36:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cef78201-b5be-4889-a2cf-bddb21e706c3 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:36:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 09:36:53 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450613.8271525, fb5ccac9-1e45-4726-b681-cf34cf3fa521 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:36:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] VM Started (Lifecycle Event)
Jul 27 09:36:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:36:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-f86cf605-21d9-4184-a593-b9f251363e38 req-93a97d15-b560-4607-8eca-e94cc656b41f service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f86cf605-21d9-4184-a593-b9f251363e38 req-93a97d15-b560-4607-8eca-e94cc656b41f service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f86cf605-21d9-4184-a593-b9f251363e38 req-93a97d15-b560-4607-8eca-e94cc656b41f service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f86cf605-21d9-4184-a593-b9f251363e38 req-93a97d15-b560-4607-8eca-e94cc656b41f service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-f86cf605-21d9-4184-a593-b9f251363e38 req-93a97d15-b560-4607-8eca-e94cc656b41f service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:36:54 user nova-compute[70374]: WARNING nova.compute.manager [req-f86cf605-21d9-4184-a593-b9f251363e38 req-93a97d15-b560-4607-8eca-e94cc656b41f service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state active and task_state None.
Jul 27 09:36:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:54 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450599.8749042, d7c1bc23-ac7f-430f-908c-c8cad8d92dca => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:36:54 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] VM Stopped (Lifecycle Event)
Jul 27 09:36:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1765036c-380a-41c8-9c96-b3f8a1b8ca8f None None] [instance: d7c1bc23-ac7f-430f-908c-c8cad8d92dca] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:36:55 user nova-compute[70374]: INFO nova.compute.claims [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Claim successful on node user
Jul 27 09:36:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.network.neutron [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:36:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.policy [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c1d49c23b0045d881d9f47e33447162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaa69b3745a435795aa636ccddec3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:36:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Creating image(s)
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "/opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "/opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk 1073741824" returned: 0 in 0.050s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG nova.network.neutron [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Successfully created port: 407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Cannot resize image /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG nova.objects.instance [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'migration_context' on Instance uuid ab9c2cd8-7137-4921-b014-5a516da0e249 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Ensure instance console log exists: /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:36:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Successfully updated port: 407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquired lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-2dde83aa-138f-4853-a23a-6231c901b83c req-778db74f-780d-4bcc-ade3-946979bc2212 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received event network-changed-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-2dde83aa-138f-4853-a23a-6231c901b83c req-778db74f-780d-4bcc-ade3-946979bc2212 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Refreshing instance network info cache due to event network-changed-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2dde83aa-138f-4853-a23a-6231c901b83c req-778db74f-780d-4bcc-ade3-946979bc2212 service nova] Acquiring lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Updating instance_info_cache with network_info: [{"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Releasing lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Instance network_info: |[{"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2dde83aa-138f-4853-a23a-6231c901b83c req-778db74f-780d-4bcc-ade3-946979bc2212 service nova] Acquired lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-2dde83aa-138f-4853-a23a-6231c901b83c req-778db74f-780d-4bcc-ade3-946979bc2212 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Refreshing network info cache for port 407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Start _get_guest_xml network_info=[{"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:36:57 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:36:57 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-381123875',display_name='tempest-AttachVolumeNegativeTest-server-381123875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-381123875',id=22,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbALol5psGEcNXzAj+xMcdNQCt5qsAk4Q5PN11kp34pOMGupCf0TWLRPqswF8va6h9PvwsGnYUAuq+iKyNwS27gUV2JyA89jLI+KKOKMGfa7c7JDrht6x0ja+eIpdJWJQ==',key_name='tempest-keypair-1992961608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-7u09ssg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=ab9c2cd8-7137-4921-b014-5a516da0e249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5a:17,bridge_name='br-int',has_traffic_filtering=True,id=407194e8-45f0-4dc4-89ab-f9ed8a4fdbed,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407194e8-45') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.objects.instance [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'pci_devices' on Instance uuid ab9c2cd8-7137-4921-b014-5a516da0e249 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:36:57 user nova-compute[70374]:   <uuid>ab9c2cd8-7137-4921-b014-5a516da0e249</uuid>
Jul 27 09:36:57 user nova-compute[70374]:   <name>instance-00000016</name>
Jul 27 09:36:57 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:36:57 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:36:57 user nova-compute[70374]:   <metadata>
Jul 27 09:36:57 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:36:57 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:36:57 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeNegativeTest-server-381123875</nova:name>
Jul 27 09:36:57 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:36:57</nova:creationTime>
Jul 27 09:36:57 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:36:57 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:36:57 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:36:57 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:36:57 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:36:57 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:36:57 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:36:57 user nova-compute[70374]:       <nova:owner>
Jul 27 09:36:57 user nova-compute[70374]:         <nova:user uuid="4c1d49c23b0045d881d9f47e33447162">tempest-AttachVolumeNegativeTest-305502590-project-member</nova:user>
Jul 27 09:36:57 user nova-compute[70374]:         <nova:project uuid="bfaa69b3745a435795aa636ccddec3af">tempest-AttachVolumeNegativeTest-305502590</nova:project>
Jul 27 09:36:57 user nova-compute[70374]:       </nova:owner>
Jul 27 09:36:57 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:36:57 user nova-compute[70374]:       <nova:ports>
Jul 27 09:36:57 user nova-compute[70374]:         <nova:port uuid="407194e8-45f0-4dc4-89ab-f9ed8a4fdbed">
Jul 27 09:36:57 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 09:36:57 user nova-compute[70374]:         </nova:port>
Jul 27 09:36:57 user nova-compute[70374]:       </nova:ports>
Jul 27 09:36:57 user nova-compute[70374]:     </nova:instance>
Jul 27 09:36:57 user nova-compute[70374]:   </metadata>
Jul 27 09:36:57 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:36:57 user nova-compute[70374]:     <system>
Jul 27 09:36:57 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:36:57 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:36:57 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:36:57 user nova-compute[70374]:       <entry name="serial">ab9c2cd8-7137-4921-b014-5a516da0e249</entry>
Jul 27 09:36:57 user nova-compute[70374]:       <entry name="uuid">ab9c2cd8-7137-4921-b014-5a516da0e249</entry>
Jul 27 09:36:57 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:36:57 user nova-compute[70374]:     </system>
Jul 27 09:36:57 user nova-compute[70374]:   </sysinfo>
Jul 27 09:36:57 user nova-compute[70374]:   <os>
Jul 27 09:36:57 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:36:57 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:36:57 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:36:57 user nova-compute[70374]:   </os>
Jul 27 09:36:57 user nova-compute[70374]:   <features>
Jul 27 09:36:57 user nova-compute[70374]:     <acpi/>
Jul 27 09:36:57 user nova-compute[70374]:     <apic/>
Jul 27 09:36:57 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:36:57 user nova-compute[70374]:   </features>
Jul 27 09:36:57 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:36:57 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:36:57 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:36:57 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:36:57 user nova-compute[70374]:   </clock>
Jul 27 09:36:57 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:36:57 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:36:57 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:36:57 user nova-compute[70374]:   </cpu>
Jul 27 09:36:57 user nova-compute[70374]:   <devices>
Jul 27 09:36:57 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:36:57 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:36:57 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk"/>
Jul 27 09:36:57 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:36:57 user nova-compute[70374]:     </disk>
Jul 27 09:36:57 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:36:57 user nova-compute[70374]:       <mac address="fa:16:3e:a6:5a:17"/>
Jul 27 09:36:57 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:36:57 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:36:57 user nova-compute[70374]:       <target dev="tap407194e8-45"/>
Jul 27 09:36:57 user nova-compute[70374]:     </interface>
Jul 27 09:36:57 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:36:57 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/console.log" append="off"/>
Jul 27 09:36:57 user nova-compute[70374]:     </serial>
Jul 27 09:36:57 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:36:57 user nova-compute[70374]:     <video>
Jul 27 09:36:57 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:36:57 user nova-compute[70374]:     </video>
Jul 27 09:36:57 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:36:57 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:36:57 user nova-compute[70374]:     </rng>
Jul 27 09:36:57 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:36:57 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:36:57 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:36:57 user nova-compute[70374]:     </memballoon>
Jul 27 09:36:57 user nova-compute[70374]:   </devices>
Jul 27 09:36:57 user nova-compute[70374]: </domain>
Jul 27 09:36:57 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-381123875',display_name='tempest-AttachVolumeNegativeTest-server-381123875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-381123875',id=22,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbALol5psGEcNXzAj+xMcdNQCt5qsAk4Q5PN11kp34pOMGupCf0TWLRPqswF8va6h9PvwsGnYUAuq+iKyNwS27gUV2JyA89jLI+KKOKMGfa7c7JDrht6x0ja+eIpdJWJQ==',key_name='tempest-keypair-1992961608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-7u09ssg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=ab9c2cd8-7137-4921-b014-5a516da0e249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5a:17,bridge_name='br-int',has_traffic_filtering=True,id=407194e8-45f0-4dc4-89ab-f9ed8a4fdbed,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407194e8-45') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG os_vif [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5a:17,bridge_name='br-int',has_traffic_filtering=True,id=407194e8-45f0-4dc4-89ab-f9ed8a4fdbed,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407194e8-45') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap407194e8-45, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap407194e8-45, col_values=(('external_ids', {'iface-id': '407194e8-45f0-4dc4-89ab-f9ed8a4fdbed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:5a:17', 'vm-uuid': 'ab9c2cd8-7137-4921-b014-5a516da0e249'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:36:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:57 user nova-compute[70374]: INFO os_vif [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5a:17,bridge_name='br-int',has_traffic_filtering=True,id=407194e8-45f0-4dc4-89ab-f9ed8a4fdbed,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407194e8-45')
Jul 27 09:36:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:36:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No VIF found with MAC fa:16:3e:a6:5a:17, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:36:58 user nova-compute[70374]: DEBUG nova.network.neutron [req-2dde83aa-138f-4853-a23a-6231c901b83c req-778db74f-780d-4bcc-ade3-946979bc2212 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Updated VIF entry in instance network info cache for port 407194e8-45f0-4dc4-89ab-f9ed8a4fdbed. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:36:58 user nova-compute[70374]: DEBUG nova.network.neutron [req-2dde83aa-138f-4853-a23a-6231c901b83c req-778db74f-780d-4bcc-ade3-946979bc2212 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Updating instance_info_cache with network_info: [{"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:36:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2dde83aa-138f-4853-a23a-6231c901b83c req-778db74f-780d-4bcc-ade3-946979bc2212 service nova] Releasing lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:36:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:36:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG nova.compute.manager [req-2a293024-6091-4215-b42c-c8254bf38ace req-84a3a086-6074-4345-bfc2-68e910295af1 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-changed-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG nova.compute.manager [req-2a293024-6091-4215-b42c-c8254bf38ace req-84a3a086-6074-4345-bfc2-68e910295af1 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Refreshing instance network info cache due to event network-changed-ed00f5b8-e247-4240-8030-6bda2ee3ea4e. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2a293024-6091-4215-b42c-c8254bf38ace req-84a3a086-6074-4345-bfc2-68e910295af1 service nova] Acquiring lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2a293024-6091-4215-b42c-c8254bf38ace req-84a3a086-6074-4345-bfc2-68e910295af1 service nova] Acquired lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG nova.network.neutron [req-2a293024-6091-4215-b42c-c8254bf38ace req-84a3a086-6074-4345-bfc2-68e910295af1 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Refreshing network info cache for port ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'flavor' on Instance uuid 1aac9621-71fc-4779-bc23-097309302b70 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG nova.network.neutron [req-2a293024-6091-4215-b42c-c8254bf38ace req-84a3a086-6074-4345-bfc2-68e910295af1 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updated VIF entry in instance network info cache for port ed00f5b8-e247-4240-8030-6bda2ee3ea4e. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG nova.network.neutron [req-2a293024-6091-4215-b42c-c8254bf38ace req-84a3a086-6074-4345-bfc2-68e910295af1 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updating instance_info_cache with network_info: [{"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2a293024-6091-4215-b42c-c8254bf38ace req-84a3a086-6074-4345-bfc2-68e910295af1 service nova] Releasing lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:00 user nova-compute[70374]: INFO nova.compute.manager [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Attaching volume 46fab09e-f5eb-4013-98b2-f9cb37ca3db5 to /dev/vdb
Jul 27 09:37:01 user nova-compute[70374]: DEBUG os_brick.utils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2716f7-e85f-4d6a-9331-62c571e3b1fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae06c19-b5fe-4ffe-b416-63157be8f6bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce478ac3-0a74-4f26-81e1-0dfd260fab4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa4f599-685a-45d5-96a1-f59bad4a0eaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:37:01 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:37:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4445fe2-a672-4401-9105-66890df3c7c4]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG os_brick.utils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updating existing volume attachment record: 0854a8db-3fbb-4bf7-a323-f93acfb9160a {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450621.8448892, ab9c2cd8-7137-4921-b014-5a516da0e249 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:37:01 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] VM Resumed (Lifecycle Event)
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:37:01 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Instance spawned successfully.
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:01 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450621.8453994, ab9c2cd8-7137-4921-b014-5a516da0e249 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:37:01 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] VM Started (Lifecycle Event)
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:37:01 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:37:01 user nova-compute[70374]: INFO nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Took 6.07 seconds to spawn the instance on the hypervisor.
Jul 27 09:37:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:02 user nova-compute[70374]: INFO nova.compute.manager [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Took 6.87 seconds to build instance.
Jul 27 09:37:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-49c20e23-d598-4801-818e-a7c0065ba168 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.966s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received event network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] No waiting events found dispatching network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:02 user nova-compute[70374]: WARNING nova.compute.manager [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received unexpected event network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed for instance with vm_state active and task_state None.
Jul 27 09:37:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received event network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] No waiting events found dispatching network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:02 user nova-compute[70374]: WARNING nova.compute.manager [req-dde14dcd-f821-4925-a437-aba87047dde7 req-a887a6a5-3827-47f0-9174-8bbec0cd1530 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received unexpected event network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed for instance with vm_state active and task_state None.
Jul 27 09:37:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:07 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:37:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 09:37:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpwZQjPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:37:08 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:37:08 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:37:08 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f48c92-0b62-42b9-9979-c230373aeaf5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:37:08 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11bb280-665c-47cb-b3a0-428163c07147]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5] added
Jul 27 09:37:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4c1186-92e5-4630-ae98-342cd6c71f06]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf7bdd-f60d-4df9-9cab-7c77338d6745]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpwZQjPh {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpwZQjPh" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc25692-8b1a-47f6-a9bd-ccf684b58326]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpwZQjPh'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebfcb68-48ec-410b-ba7f-df0a68eaa89a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d983a-e088-4e35-9eab-6fa2293419f3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e4ad1c-fe01-452c-810b-16519a57a9e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5, portal: 172.16.0.220,3260]
Jul 27 09:37:08 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5, portal: 172.16.0.220,3260] successful.
Jul 27 09:37:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e31e83b-bd9e-4834-ab2e-7e7e4678a9e0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ebb9c7-8a29-4d65-bb3f-a3de65ec0d75]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:08 user nova-compute[70374]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 (non-flash)
Jul 27 09:37:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:08 user nova-compute[70374]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 (non-flash)
Jul 27 09:37:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:37:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:09 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d28616-153f-4f4d-b12d-637d1c3153db]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:09 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:37:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpwZQjPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:37:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:37:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23639336535333938', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639336535333938', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'flavor' on Instance uuid 1aac9621-71fc-4779-bc23-097309302b70 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:37:10 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:37:10 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:37:10 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:37:10 user nova-compute[70374]:   <serial>46fab09e-f5eb-4013-98b2-f9cb37ca3db5</serial>
Jul 27 09:37:10 user nova-compute[70374]: </disk>
Jul 27 09:37:10 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] No VIF found with MAC fa:16:3e:8b:28:16, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1e2b0a33-6826-4654-a082-29eb975f5fc3 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.709s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: INFO nova.compute.manager [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Detaching volume 46fab09e-f5eb-4013-98b2-f9cb37ca3db5
Jul 27 09:37:13 user nova-compute[70374]: INFO nova.virt.block_device [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Attempting to driver detach volume 46fab09e-f5eb-4013-98b2-f9cb37ca3db5 from mountpoint /dev/vdb
Jul 27 09:37:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Attempting to detach device vdb from instance 1aac9621-71fc-4779-bc23-097309302b70 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:37:13 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:37:13 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:37:13 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:37:13 user nova-compute[70374]:   <serial>46fab09e-f5eb-4013-98b2-f9cb37ca3db5</serial>
Jul 27 09:37:13 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:37:13 user nova-compute[70374]: </disk>
Jul 27 09:37:13 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:37:13 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Successfully detached device vdb from instance 1aac9621-71fc-4779-bc23-097309302b70 from the persistent domain config.
Jul 27 09:37:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1aac9621-71fc-4779-bc23-097309302b70 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:37:13 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:37:13 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:37:13 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:37:13 user nova-compute[70374]:   <serial>46fab09e-f5eb-4013-98b2-f9cb37ca3db5</serial>
Jul 27 09:37:13 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:37:13 user nova-compute[70374]: </disk>
Jul 27 09:37:13 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450633.6836572, 1aac9621-71fc-4779-bc23-097309302b70 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1aac9621-71fc-4779-bc23-097309302b70 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:37:13 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Successfully detached device vdb from instance 1aac9621-71fc-4779-bc23-097309302b70 from the live domain config.
Jul 27 09:37:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpwZQjPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:37:13 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd78c161-c83d-42ca-9ddd-1d58e5dc8309]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:37:13 user nova-compute[70374]: No targets found.
Jul 27 09:37:13 user nova-compute[70374]: iSNS:
Jul 27 09:37:13 user nova-compute[70374]: No targets found.
Jul 27 09:37:13 user nova-compute[70374]: STATIC:
Jul 27 09:37:13 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b
Jul 27 09:37:13 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:37:13 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:37:13 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5
Jul 27 09:37:13 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:37:13 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:37:13 user nova-compute[70374]: FIRMWARE:
Jul 27 09:37:13 user nova-compute[70374]: No targets found.
Jul 27 09:37:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:37:13 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:37:13 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2469d181-5f89-4a91-8770-33fce77b045e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[460c3cb6-f8af-41fb-ac20-2b0521cea96f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:13 user nova-compute[70374]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 (non-flash)
Jul 27 09:37:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:13 user nova-compute[70374]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 (non-flash)
Jul 27 09:37:13 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc1b0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7672c347-0bcf-43e2-995e-84c161cbc0bc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3516cfef-c5fa-41e4-a5a2-5a4b1c01b3ad]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3010233e-17f0-4af3-b015-546c8307c170]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b2517a-dabf-4edf-97bd-aa0aa987c2a2]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09bc49c-793c-456d-b26a-738cf491ffef]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee59aaa-e740-472e-9a83-335cfed331d4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5, portal: 172.16.0.220,3260]
Jul 27 09:37:14 user nova-compute[70374]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5, portal: 172.16.0.220,3260] successful.
Jul 27 09:37:14 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46fab09e-f5eb-4013-98b2-f9cb37ca3db5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db8910-d85c-4acc-838b-6eed6e314525]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] <== disconnect_volume: return (395ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:37:14 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:37:14 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.515945434570312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 30aa3eca-5c9f-443a-af70-461010d4e22e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 1aac9621-71fc-4779-bc23-097309302b70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance aba5a5a4-266b-4511-86ee-258843bd41a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 69a59942-cd83-4f74-82ea-f23a6538cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance e35e780b-67f2-4617-bbc6-45ee7dc92d96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ab9c2cd8-7137-4921-b014-5a516da0e249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG nova.objects.instance [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'flavor' on Instance uuid 1aac9621-71fc-4779-bc23-097309302b70 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-281e3abe-9e20-43e1-a7e0-1a318732ebe6 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.876s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:15 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:37:15 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:37:15 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:37:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:37:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-c0695e1b-6a8a-4913-8454-19e1a775b569 req-6b19ce5b-02fe-4c9a-bcd7-af9c118eeb91 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-changed-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-c0695e1b-6a8a-4913-8454-19e1a775b569 req-6b19ce5b-02fe-4c9a-bcd7-af9c118eeb91 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Refreshing instance network info cache due to event network-changed-6b853298-921d-44cf-951d-d55fe9364ac3. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:37:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c0695e1b-6a8a-4913-8454-19e1a775b569 req-6b19ce5b-02fe-4c9a-bcd7-af9c118eeb91 service nova] Acquiring lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:37:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c0695e1b-6a8a-4913-8454-19e1a775b569 req-6b19ce5b-02fe-4c9a-bcd7-af9c118eeb91 service nova] Acquired lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:37:24 user nova-compute[70374]: DEBUG nova.network.neutron [req-c0695e1b-6a8a-4913-8454-19e1a775b569 req-6b19ce5b-02fe-4c9a-bcd7-af9c118eeb91 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Refreshing network info cache for port 6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:37:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.network.neutron [req-c0695e1b-6a8a-4913-8454-19e1a775b569 req-6b19ce5b-02fe-4c9a-bcd7-af9c118eeb91 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Updated VIF entry in instance network info cache for port 6b853298-921d-44cf-951d-d55fe9364ac3. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.network.neutron [req-c0695e1b-6a8a-4913-8454-19e1a775b569 req-6b19ce5b-02fe-4c9a-bcd7-af9c118eeb91 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Updating instance_info_cache with network_info: [{"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:37:25 user nova-compute[70374]: INFO nova.compute.manager [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Rebuilding instance
Jul 27 09:37:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c0695e1b-6a8a-4913-8454-19e1a775b569 req-6b19ce5b-02fe-4c9a-bcd7-af9c118eeb91 service nova] Releasing lock "refresh_cache-aba5a5a4-266b-4511-86ee-258843bd41a5" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'trusted_certs' on Instance uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'pci_requests' on Instance uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'pci_devices' on Instance uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'resources' on Instance uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'migration_context' on Instance uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70374) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance destroyed successfully.
Jul 27 09:37:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance destroyed successfully.
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1139130470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1596074640',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8G6KrvwXmmOIoccubLX+h6m1EvIBOsR9+vrs/DIs+D3vVzZbUf4UgeHVwvBZKMtROvY8D1A5S38Px3VM0d025CGUjOdGb+pLp/X7j79D5ZGu1WOGNArT636xnxQb1rRw==',key_name='tempest-keypair-828280280',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-00d5td73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=aba5a5a4-266b-4511-86ee-258843bd41a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_vif [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b853298-92, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-unplugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] No waiting events found dispatching network-vif-unplugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:26 user nova-compute[70374]: WARNING nova.compute.manager [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received unexpected event network-vif-unplugged-6b853298-921d-44cf-951d-d55fe9364ac3 for instance with vm_state active and task_state rebuilding.
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] No waiting events found dispatching network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:26 user nova-compute[70374]: WARNING nova.compute.manager [req-87397645-0fd7-41a1-87b1-4882056b1fd6 req-1adee563-87ae-4e72-9acc-d5ab899d6c04 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received unexpected event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 for instance with vm_state active and task_state rebuilding.
Jul 27 09:37:26 user nova-compute[70374]: INFO os_vif [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92')
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:37:26 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0755ab22-2323-4b9c-a991-903db2829c31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:37:26 user nova-compute[70374]: No targets found.
Jul 27 09:37:26 user nova-compute[70374]: iSNS:
Jul 27 09:37:26 user nova-compute[70374]: No targets found.
Jul 27 09:37:26 user nova-compute[70374]: STATIC:
Jul 27 09:37:26 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b
Jul 27 09:37:26 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:37:26 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:37:26 user nova-compute[70374]: FIRMWARE:
Jul 27 09:37:26 user nova-compute[70374]: No targets found.
Jul 27 09:37:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:37:26 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:37:26 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd31428-661b-44ce-a646-e7e95be3a919]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aad8332-db0d-42b8-9ce3-eb8ecfbd6fa4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc1b12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b'): ({'sdf'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Removing single pathed devices sdf {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f9d85a-8137-449d-965c-30d54ddf7552]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b99f3a-cc80-4744-b236-2d4b329f56e9]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Flushing IO for device /dev/sdf {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de0d9e9-cfbc-4fe5-9b2d-1affa6220c4e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[45645374-2620-4d10-814b-ba6dc693d549]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] SCSI volumes sdf have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c7e4e576', '/dev/disk/by-id/scsi-1SCST_BIOc7e4e576-1c9e58df88db46fb', '/dev/disk/by-id/scsi-23163396535386466') {{(pid=82164) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[45100d55-1386-40e9-9dd4-52f1fa612d73]: (4, None) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[905bd107-8832-4e14-af97-247cdf6e819e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f84ec3-9e8b-445b-8351-07f3118078e0]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260]
Jul 27 09:37:26 user nova-compute[70374]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260] successful.
Jul 27 09:37:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8897c1cb-f050-4a78-b65b-674c51a17143]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] <== disconnect_volume: return (308ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:37:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:37:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Deleting instance files /opt/stack/data/nova/instances/aba5a5a4-266b-4511-86ee-258843bd41a5_del
Jul 27 09:37:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Deletion of /opt/stack/data/nova/instances/aba5a5a4-266b-4511-86ee-258843bd41a5_del complete
Jul 27 09:37:27 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance aba5a5a4-266b-4511-86ee-258843bd41a5 could not be found.
Jul 27 09:37:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:37:27 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 09:37:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[12c5000f-441f-46a7-ab9a-83e4628d29cc]: Unexpected error while running command.
Jul 27 09:37:27 user nova-compute[70374]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 09:37:27 user nova-compute[70374]: Exit code: 21
Jul 27 09:37:27 user nova-compute[70374]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 09:37:27 user nova-compute[70374]: Stderr: '' {{(pid=82164) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Jul 27 09:37:27 user nova-compute[70374]: Traceback (most recent call last):
Jul 27 09:37:27 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jul 27 09:37:27 user nova-compute[70374]:     ret = func(*f_args, **f_kwargs)
Jul 27 09:37:27 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jul 27 09:37:27 user nova-compute[70374]:     return func(*args, **kwargs)
Jul 27 09:37:27 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jul 27 09:37:27 user nova-compute[70374]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jul 27 09:37:27 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jul 27 09:37:27 user nova-compute[70374]:     return putils.execute(on_execute=on_execute,
Jul 27 09:37:27 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Jul 27 09:37:27 user nova-compute[70374]:     raise ProcessExecutionError(exit_code=_returncode,
Jul 27 09:37:27 user nova-compute[70374]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 09:37:27 user nova-compute[70374]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 09:37:27 user nova-compute[70374]: Exit code: 21
Jul 27 09:37:27 user nova-compute[70374]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 09:37:27 user nova-compute[70374]: Stderr: ''
Jul 27 09:37:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c5000f-441f-46a7-ab9a-83e4628d29cc]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 09:37:27 user nova-compute[70374]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 09:37:27 user nova-compute[70374]: Exit code: 21
Jul 27 09:37:27 user nova-compute[70374]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 09:37:27 user nova-compute[70374]: Stderr: ''
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi 
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi 
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Jul 27 09:37:27 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi 
Jul 27 09:37:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=70374) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] <== disconnect_volume: return (43ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Preparing to wait for external event volume-reimaged-25a4bd30-7c85-4645-88ac-cb52c4883a2b {{(pid=70374) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-b15aed1e-13d2-44c4-ba71-edfc60c50e7d req-f0fce9d7-640f-4e2b-92d4-89ee9c0c3246 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-changed-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-b15aed1e-13d2-44c4-ba71-edfc60c50e7d req-f0fce9d7-640f-4e2b-92d4-89ee9c0c3246 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Refreshing instance network info cache due to event network-changed-08a126de-9aff-4def-baa5-0401181a8d3b. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:37:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b15aed1e-13d2-44c4-ba71-edfc60c50e7d req-f0fce9d7-640f-4e2b-92d4-89ee9c0c3246 service nova] Acquiring lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:37:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b15aed1e-13d2-44c4-ba71-edfc60c50e7d req-f0fce9d7-640f-4e2b-92d4-89ee9c0c3246 service nova] Acquired lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:37:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-b15aed1e-13d2-44c4-ba71-edfc60c50e7d req-f0fce9d7-640f-4e2b-92d4-89ee9c0c3246 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Refreshing network info cache for port 08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:37:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-b15aed1e-13d2-44c4-ba71-edfc60c50e7d req-f0fce9d7-640f-4e2b-92d4-89ee9c0c3246 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updated VIF entry in instance network info cache for port 08a126de-9aff-4def-baa5-0401181a8d3b. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:37:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-b15aed1e-13d2-44c4-ba71-edfc60c50e7d req-f0fce9d7-640f-4e2b-92d4-89ee9c0c3246 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:37:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b15aed1e-13d2-44c4-ba71-edfc60c50e7d req-f0fce9d7-640f-4e2b-92d4-89ee9c0c3246 service nova] Releasing lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:37:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:35 user nova-compute[70374]: INFO nova.compute.manager [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] instance snapshotting
Jul 27 09:37:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Beginning live snapshot process
Jul 27 09:37:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json -f qcow2 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json -f qcow2 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.173s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpej4zoj4d/bbed9693dc74429e9bdf8486adea2829.delta 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpej4zoj4d/bbed9693dc74429e9bdf8486adea2829.delta 1073741824" returned: 0 in 0.059s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 09:37:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:37:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:37:37 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 09:37:38 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:37:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpej4zoj4d/bbed9693dc74429e9bdf8486adea2829.delta /opt/stack/data/nova/instances/snapshots/tmpej4zoj4d/bbed9693dc74429e9bdf8486adea2829 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpej4zoj4d/bbed9693dc74429e9bdf8486adea2829.delta /opt/stack/data/nova/instances/snapshots/tmpej4zoj4d/bbed9693dc74429e9bdf8486adea2829" returned: 0 in 0.448s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:38 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Snapshot extracted, beginning image upload
Jul 27 09:37:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450646.4166608, aba5a5a4-266b-4511-86ee-258843bd41a5 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:37:41 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] VM Stopped (Lifecycle Event)
Jul 27 09:37:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5fa48dee-7889-4fc0-be87-af16f40839ff None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Snapshot image upload complete
Jul 27 09:37:41 user nova-compute[70374]: INFO nova.compute.manager [None req-2839272b-c423-4c77-9e1e-913192b25166 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Took 6.25 seconds to snapshot the instance on the hypervisor.
Jul 27 09:37:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:41 user nova-compute[70374]: INFO nova.compute.manager [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Terminating instance
Jul 27 09:37:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-e0a2c3d6-7f7c-416f-9985-03f81e0c62db req-a4cca0f6-de84-4049-8a8a-24be7ebe0017 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received event network-vif-unplugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e0a2c3d6-7f7c-416f-9985-03f81e0c62db req-a4cca0f6-de84-4049-8a8a-24be7ebe0017 service nova] Acquiring lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e0a2c3d6-7f7c-416f-9985-03f81e0c62db req-a4cca0f6-de84-4049-8a8a-24be7ebe0017 service nova] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e0a2c3d6-7f7c-416f-9985-03f81e0c62db req-a4cca0f6-de84-4049-8a8a-24be7ebe0017 service nova] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-e0a2c3d6-7f7c-416f-9985-03f81e0c62db req-a4cca0f6-de84-4049-8a8a-24be7ebe0017 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] No waiting events found dispatching network-vif-unplugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-e0a2c3d6-7f7c-416f-9985-03f81e0c62db req-a4cca0f6-de84-4049-8a8a-24be7ebe0017 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received event network-vif-unplugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:37:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Instance destroyed successfully.
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.objects.instance [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lazy-loading 'resources' on Instance uuid e35e780b-67f2-4617-bbc6-45ee7dc92d96 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1352115583',display_name='tempest-VolumesActionsTest-instance-1352115583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1352115583',id=21,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='856989e8171645fc9a6e6c1cbb2358fb',ramdisk_id='',reservation_id='r-fncnz6eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1348517842',owner_user_name='tempest-VolumesActionsTest-1348517842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:58Z,user_data=None,user_id='7dfadf5215e24c45a8f55022e1cda47b',uuid=e35e780b-67f2-4617-bbc6-45ee7dc92d96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converting VIF {"id": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "address": "fa:16:3e:db:ce:12", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc35b1a97-d7", "ovs_interfaceid": "c35b1a97-d719-4fbc-b930-4935aeb17c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ce:12,bridge_name='br-int',has_traffic_filtering=True,id=c35b1a97-d719-4fbc-b930-4935aeb17c3f,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc35b1a97-d7') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG os_vif [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ce:12,bridge_name='br-int',has_traffic_filtering=True,id=c35b1a97-d719-4fbc-b930-4935aeb17c3f,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc35b1a97-d7') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc35b1a97-d7, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:42 user nova-compute[70374]: INFO os_vif [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ce:12,bridge_name='br-int',has_traffic_filtering=True,id=c35b1a97-d719-4fbc-b930-4935aeb17c3f,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc35b1a97-d7')
Jul 27 09:37:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Deleting instance files /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96_del
Jul 27 09:37:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Deletion of /opt/stack/data/nova/instances/e35e780b-67f2-4617-bbc6-45ee7dc92d96_del complete
Jul 27 09:37:42 user nova-compute[70374]: INFO nova.compute.manager [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 27 09:37:42 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:37:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:43 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:37:43 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Took 0.90 seconds to deallocate network for instance.
Jul 27 09:37:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-9afdc155-ec8a-4dc5-b70f-0dbd0ec4345c req-f3ffa714-a509-47de-9ad2-b5a1384323d9 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received event network-vif-deleted-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:43 user nova-compute[70374]: INFO nova.compute.manager [req-9afdc155-ec8a-4dc5-b70f-0dbd0ec4345c req-f3ffa714-a509-47de-9ad2-b5a1384323d9 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Neutron deleted interface c35b1a97-d719-4fbc-b930-4935aeb17c3f; detaching it from the instance and deleting it from the info cache
Jul 27 09:37:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-9afdc155-ec8a-4dc5-b70f-0dbd0ec4345c req-f3ffa714-a509-47de-9ad2-b5a1384323d9 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:37:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-9afdc155-ec8a-4dc5-b70f-0dbd0ec4345c req-f3ffa714-a509-47de-9ad2-b5a1384323d9 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Detach interface failed, port_id=c35b1a97-d719-4fbc-b930-4935aeb17c3f, reason: Instance e35e780b-67f2-4617-bbc6-45ee7dc92d96 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:37:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:44 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Deleted allocations for instance e35e780b-67f2-4617-bbc6-45ee7dc92d96
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-70fc0008-47b1-4cef-8a09-c8c93a20722b tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.448s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-150be56e-7355-477e-af55-b50457deeea4 req-2c2d30ec-1af1-419c-9dd6-a81320717800 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received event network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-150be56e-7355-477e-af55-b50457deeea4 req-2c2d30ec-1af1-419c-9dd6-a81320717800 service nova] Acquiring lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-150be56e-7355-477e-af55-b50457deeea4 req-2c2d30ec-1af1-419c-9dd6-a81320717800 service nova] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-150be56e-7355-477e-af55-b50457deeea4 req-2c2d30ec-1af1-419c-9dd6-a81320717800 service nova] Lock "e35e780b-67f2-4617-bbc6-45ee7dc92d96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-150be56e-7355-477e-af55-b50457deeea4 req-2c2d30ec-1af1-419c-9dd6-a81320717800 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] No waiting events found dispatching network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:44 user nova-compute[70374]: WARNING nova.compute.manager [req-150be56e-7355-477e-af55-b50457deeea4 req-2c2d30ec-1af1-419c-9dd6-a81320717800 service nova] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Received unexpected event network-vif-plugged-c35b1a97-d719-4fbc-b930-4935aeb17c3f for instance with vm_state deleted and task_state None.
Jul 27 09:37:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-320406e8-32cc-40c9-8ca7-8d765d638853 req-8091a6bc-36d3-4fad-808f-af2403ae3c38 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event volume-reimaged-25a4bd30-7c85-4645-88ac-cb52c4883a2b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-320406e8-32cc-40c9-8ca7-8d765d638853 req-8091a6bc-36d3-4fad-808f-af2403ae3c38 service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-320406e8-32cc-40c9-8ca7-8d765d638853 req-8091a6bc-36d3-4fad-808f-af2403ae3c38 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-320406e8-32cc-40c9-8ca7-8d765d638853 req-8091a6bc-36d3-4fad-808f-af2403ae3c38 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-320406e8-32cc-40c9-8ca7-8d765d638853 req-8091a6bc-36d3-4fad-808f-af2403ae3c38 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Processing event volume-reimaged-25a4bd30-7c85-4645-88ac-cb52c4883a2b {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:37:44 user nova-compute[70374]: INFO nova.virt.block_device [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Booting with volume 25a4bd30-7c85-4645-88ac-cb52c4883a2b at /dev/vda
Jul 27 09:37:44 user nova-compute[70374]: DEBUG os_brick.utils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0fd0b-40d9-4fff-97d1-308079c80915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0971d03f-c94b-4cc5-bde9-ad012056d1dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8c3aa9-b5b1-4eef-843a-1346d64f5472]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[913b234e-47d4-4e59-af8c-c7f661448214]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:37:44 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:37:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[899b304d-6097-4642-aee7-25da4237f3c8]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG os_brick.utils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Updating existing volume attachment record: b7c0ff38-b4fe-4d52-8c96-c444adc30bc0 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:37:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:37:46 user nova-compute[70374]: INFO nova.compute.claims [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Claim successful on node user
Jul 27 09:37:46 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:37:47 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:37:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG nova.policy [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2b416973f744369818b2a67bcecdeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06bd4d4e7144fbc99c907fb405b7e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:37:47 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Creating image(s)
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.082s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.197s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk 1073741824" returned: 0 in 0.060s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:37:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Cannot resize image /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'migration_context' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Ensure instance console log exists: /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:48 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Successfully created port: 5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Successfully updated port: 5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquired lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-4288d646-41eb-42d8-a58b-1912c7577c84 req-774bb588-28ff-484d-bf03-9b94e724d195 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-changed-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-4288d646-41eb-42d8-a58b-1912c7577c84 req-774bb588-28ff-484d-bf03-9b94e724d195 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Refreshing instance network info cache due to event network-changed-5e54f01f-0732-4e78-bcc1-f9e45af08a0a. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4288d646-41eb-42d8-a58b-1912c7577c84 req-774bb588-28ff-484d-bf03-9b94e724d195 service nova] Acquiring lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Releasing lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance network_info: |[{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4288d646-41eb-42d8-a58b-1912c7577c84 req-774bb588-28ff-484d-bf03-9b94e724d195 service nova] Acquired lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.neutron [req-4288d646-41eb-42d8-a58b-1912c7577c84 req-774bb588-28ff-484d-bf03-9b94e724d195 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Refreshing network info cache for port 5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Start _get_guest_xml network_info=[{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:37:49 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:37:49 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-423924851',display_name='tempest-ServerActionsTestOtherA-server-423924851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-423924851',id=23,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-25r1p5d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=206f2727-3adb-4f39-b1d6-4ec1352e8cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'pci_devices' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:37:49 user nova-compute[70374]:   <uuid>206f2727-3adb-4f39-b1d6-4ec1352e8cf8</uuid>
Jul 27 09:37:49 user nova-compute[70374]:   <name>instance-00000017</name>
Jul 27 09:37:49 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:37:49 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:37:49 user nova-compute[70374]:   <metadata>
Jul 27 09:37:49 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:37:49 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:37:49 user nova-compute[70374]:       <nova:name>tempest-ServerActionsTestOtherA-server-423924851</nova:name>
Jul 27 09:37:49 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:37:49</nova:creationTime>
Jul 27 09:37:49 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:37:49 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:37:49 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:37:49 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:37:49 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:37:49 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:37:49 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:37:49 user nova-compute[70374]:       <nova:owner>
Jul 27 09:37:49 user nova-compute[70374]:         <nova:user uuid="a2b416973f744369818b2a67bcecdeb9">tempest-ServerActionsTestOtherA-2053926798-project-member</nova:user>
Jul 27 09:37:49 user nova-compute[70374]:         <nova:project uuid="f06bd4d4e7144fbc99c907fb405b7e99">tempest-ServerActionsTestOtherA-2053926798</nova:project>
Jul 27 09:37:49 user nova-compute[70374]:       </nova:owner>
Jul 27 09:37:49 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:37:49 user nova-compute[70374]:       <nova:ports>
Jul 27 09:37:49 user nova-compute[70374]:         <nova:port uuid="5e54f01f-0732-4e78-bcc1-f9e45af08a0a">
Jul 27 09:37:49 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 09:37:49 user nova-compute[70374]:         </nova:port>
Jul 27 09:37:49 user nova-compute[70374]:       </nova:ports>
Jul 27 09:37:49 user nova-compute[70374]:     </nova:instance>
Jul 27 09:37:49 user nova-compute[70374]:   </metadata>
Jul 27 09:37:49 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:37:49 user nova-compute[70374]:     <system>
Jul 27 09:37:49 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:37:49 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:37:49 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:37:49 user nova-compute[70374]:       <entry name="serial">206f2727-3adb-4f39-b1d6-4ec1352e8cf8</entry>
Jul 27 09:37:49 user nova-compute[70374]:       <entry name="uuid">206f2727-3adb-4f39-b1d6-4ec1352e8cf8</entry>
Jul 27 09:37:49 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:37:49 user nova-compute[70374]:     </system>
Jul 27 09:37:49 user nova-compute[70374]:   </sysinfo>
Jul 27 09:37:49 user nova-compute[70374]:   <os>
Jul 27 09:37:49 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:37:49 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:37:49 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:37:49 user nova-compute[70374]:   </os>
Jul 27 09:37:49 user nova-compute[70374]:   <features>
Jul 27 09:37:49 user nova-compute[70374]:     <acpi/>
Jul 27 09:37:49 user nova-compute[70374]:     <apic/>
Jul 27 09:37:49 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:37:49 user nova-compute[70374]:   </features>
Jul 27 09:37:49 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:37:49 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:37:49 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:37:49 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:37:49 user nova-compute[70374]:   </clock>
Jul 27 09:37:49 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:37:49 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:37:49 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:37:49 user nova-compute[70374]:   </cpu>
Jul 27 09:37:49 user nova-compute[70374]:   <devices>
Jul 27 09:37:49 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:37:49 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:37:49 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk"/>
Jul 27 09:37:49 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:37:49 user nova-compute[70374]:     </disk>
Jul 27 09:37:49 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:37:49 user nova-compute[70374]:       <mac address="fa:16:3e:8f:9b:7f"/>
Jul 27 09:37:49 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:37:49 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:37:49 user nova-compute[70374]:       <target dev="tap5e54f01f-07"/>
Jul 27 09:37:49 user nova-compute[70374]:     </interface>
Jul 27 09:37:49 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:37:49 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/console.log" append="off"/>
Jul 27 09:37:49 user nova-compute[70374]:     </serial>
Jul 27 09:37:49 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:37:49 user nova-compute[70374]:     <video>
Jul 27 09:37:49 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:37:49 user nova-compute[70374]:     </video>
Jul 27 09:37:49 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:37:49 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:37:49 user nova-compute[70374]:     </rng>
Jul 27 09:37:49 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:37:49 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:37:49 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:37:49 user nova-compute[70374]:     </memballoon>
Jul 27 09:37:49 user nova-compute[70374]:   </devices>
Jul 27 09:37:49 user nova-compute[70374]: </domain>
Jul 27 09:37:49 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-423924851',display_name='tempest-ServerActionsTestOtherA-server-423924851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-423924851',id=23,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-25r1p5d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=206f2727-3adb-4f39-b1d6-4ec1352e8cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG os_vif [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e54f01f-07, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e54f01f-07, col_values=(('external_ids', {'iface-id': '5e54f01f-0732-4e78-bcc1-f9e45af08a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:9b:7f', 'vm-uuid': '206f2727-3adb-4f39-b1d6-4ec1352e8cf8'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:49 user nova-compute[70374]: INFO os_vif [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07')
Jul 27 09:37:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No VIF found with MAC fa:16:3e:8f:9b:7f, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.neutron [req-4288d646-41eb-42d8-a58b-1912c7577c84 req-774bb588-28ff-484d-bf03-9b94e724d195 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updated VIF entry in instance network info cache for port 5e54f01f-0732-4e78-bcc1-f9e45af08a0a. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG nova.network.neutron [req-4288d646-41eb-42d8-a58b-1912c7577c84 req-774bb588-28ff-484d-bf03-9b94e724d195 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:37:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4288d646-41eb-42d8-a58b-1912c7577c84 req-774bb588-28ff-484d-bf03-9b94e724d195 service nova] Releasing lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:37:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-96eaf5a7-20b3-4e76-8caa-328399d013e7 req-3d423739-7960-40d1-ad46-79c6ab6d3a4d service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96eaf5a7-20b3-4e76-8caa-328399d013e7 req-3d423739-7960-40d1-ad46-79c6ab6d3a4d service nova] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96eaf5a7-20b3-4e76-8caa-328399d013e7 req-3d423739-7960-40d1-ad46-79c6ab6d3a4d service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96eaf5a7-20b3-4e76-8caa-328399d013e7 req-3d423739-7960-40d1-ad46-79c6ab6d3a4d service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-96eaf5a7-20b3-4e76-8caa-328399d013e7 req-3d423739-7960-40d1-ad46-79c6ab6d3a4d service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] No waiting events found dispatching network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:51 user nova-compute[70374]: WARNING nova.compute.manager [req-96eaf5a7-20b3-4e76-8caa-328399d013e7 req-3d423739-7960-40d1-ad46-79c6ab6d3a4d service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received unexpected event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a for instance with vm_state building and task_state spawning.
Jul 27 09:37:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:37:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Creating image(s)
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Ensure instance console log exists: /opt/stack/data/nova/instances/aba5a5a4-266b-4511-86ee-258843bd41a5/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Start _get_guest_xml network_info=[{"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'b7c0ff38-b4fe-4d52-8c96-c444adc30bc0', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aba5a5a4-266b-4511-86ee-258843bd41a5', 'attached_at': '', 'detached_at': '', 'volume_id': '25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'serial': '25a4bd30-7c85-4645-88ac-cb52c4883a2b'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:37:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 09:37:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.objects.instance [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'vcpu_model' on Instance uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:37:51 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:37:51 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:37:51 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e94248-4030-49b3-94a6-d7bc43b6ae1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:37:51 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d1e9f5-47e8-4b8b-8074-dd023b520c2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b] added
Jul 27 09:37:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72545ca-69ba-43f9-9edc-69b1482c8263]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b9447-55d1-422c-850f-99c49c40b30f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcAVmPHh {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcAVmPHh" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[460502cb-7fac-4b12-99aa-6d0553626ab9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcAVmPHh'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bba288-743f-4b28-9cc1-c86af0266d1c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecf15e5-9b37-40fc-b665-424af909569a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:37:52 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:37:52 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:37:52 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 09:37:52 user nova-compute[70374]: : NotImplementedError
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be6643-6cdc-41e2-96ed-35f865c07d59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260]
Jul 27 09:37:52 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260] successful.
Jul 27 09:37:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d816e70b-b5f4-491c-8638-abfe6e6c7832]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[21843ce6-4119-4190-b902-12d23b52f657]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:37:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2fbb17-f215-493c-9fa4-c0d1f0207fdd]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:37:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23163396535386466', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163396535386466', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1139130470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1596074640',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8G6KrvwXmmOIoccubLX+h6m1EvIBOsR9+vrs/DIs+D3vVzZbUf4UgeHVwvBZKMtROvY8D1A5S38Px3VM0d025CGUjOdGb+pLp/X7j79D5ZGu1WOGNArT636xnxQb1rRw==',key_name='tempest-keypair-828280280',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-00d5td73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=aba5a5a4-266b-4511-86ee-258843bd41a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:37:53 user nova-compute[70374]:   <uuid>aba5a5a4-266b-4511-86ee-258843bd41a5</uuid>
Jul 27 09:37:53 user nova-compute[70374]:   <name>instance-00000013</name>
Jul 27 09:37:53 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:37:53 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:37:53 user nova-compute[70374]:   <metadata>
Jul 27 09:37:53 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:37:53 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:37:53 user nova-compute[70374]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1139130470</nova:name>
Jul 27 09:37:53 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:37:51</nova:creationTime>
Jul 27 09:37:53 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:37:53 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:37:53 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:37:53 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:37:53 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:37:53 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:37:53 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:37:53 user nova-compute[70374]:       <nova:owner>
Jul 27 09:37:53 user nova-compute[70374]:         <nova:user uuid="b56b56f07f0c4674a09485173c97fd4f">tempest-ServerActionsV293TestJSON-405523215-project-member</nova:user>
Jul 27 09:37:53 user nova-compute[70374]:         <nova:project uuid="c072c9f639974ac186a9d8b94baaab20">tempest-ServerActionsV293TestJSON-405523215</nova:project>
Jul 27 09:37:53 user nova-compute[70374]:       </nova:owner>
Jul 27 09:37:53 user nova-compute[70374]:       <nova:ports>
Jul 27 09:37:53 user nova-compute[70374]:         <nova:port uuid="6b853298-921d-44cf-951d-d55fe9364ac3">
Jul 27 09:37:53 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 09:37:53 user nova-compute[70374]:         </nova:port>
Jul 27 09:37:53 user nova-compute[70374]:       </nova:ports>
Jul 27 09:37:53 user nova-compute[70374]:     </nova:instance>
Jul 27 09:37:53 user nova-compute[70374]:   </metadata>
Jul 27 09:37:53 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:37:53 user nova-compute[70374]:     <system>
Jul 27 09:37:53 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:37:53 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:37:53 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:37:53 user nova-compute[70374]:       <entry name="serial">aba5a5a4-266b-4511-86ee-258843bd41a5</entry>
Jul 27 09:37:53 user nova-compute[70374]:       <entry name="uuid">aba5a5a4-266b-4511-86ee-258843bd41a5</entry>
Jul 27 09:37:53 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:37:53 user nova-compute[70374]:     </system>
Jul 27 09:37:53 user nova-compute[70374]:   </sysinfo>
Jul 27 09:37:53 user nova-compute[70374]:   <os>
Jul 27 09:37:53 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:37:53 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:37:53 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:37:53 user nova-compute[70374]:   </os>
Jul 27 09:37:53 user nova-compute[70374]:   <features>
Jul 27 09:37:53 user nova-compute[70374]:     <acpi/>
Jul 27 09:37:53 user nova-compute[70374]:     <apic/>
Jul 27 09:37:53 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:37:53 user nova-compute[70374]:   </features>
Jul 27 09:37:53 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:37:53 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:37:53 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:37:53 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:37:53 user nova-compute[70374]:   </clock>
Jul 27 09:37:53 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:37:53 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:37:53 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:37:53 user nova-compute[70374]:   </cpu>
Jul 27 09:37:53 user nova-compute[70374]:   <devices>
Jul 27 09:37:53 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:37:53 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:37:53 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 09:37:53 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:37:53 user nova-compute[70374]:       <serial>25a4bd30-7c85-4645-88ac-cb52c4883a2b</serial>
Jul 27 09:37:53 user nova-compute[70374]:     </disk>
Jul 27 09:37:53 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:37:53 user nova-compute[70374]:       <mac address="fa:16:3e:16:85:da"/>
Jul 27 09:37:53 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:37:53 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:37:53 user nova-compute[70374]:       <target dev="tap6b853298-92"/>
Jul 27 09:37:53 user nova-compute[70374]:     </interface>
Jul 27 09:37:53 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:37:53 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/aba5a5a4-266b-4511-86ee-258843bd41a5/console.log" append="off"/>
Jul 27 09:37:53 user nova-compute[70374]:     </serial>
Jul 27 09:37:53 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:37:53 user nova-compute[70374]:     <video>
Jul 27 09:37:53 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:37:53 user nova-compute[70374]:     </video>
Jul 27 09:37:53 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:37:53 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:37:53 user nova-compute[70374]:     </rng>
Jul 27 09:37:53 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:37:53 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:37:53 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:37:53 user nova-compute[70374]:     </memballoon>
Jul 27 09:37:53 user nova-compute[70374]:   </devices>
Jul 27 09:37:53 user nova-compute[70374]: </domain>
Jul 27 09:37:53 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1139130470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1596074640',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8G6KrvwXmmOIoccubLX+h6m1EvIBOsR9+vrs/DIs+D3vVzZbUf4UgeHVwvBZKMtROvY8D1A5S38Px3VM0d025CGUjOdGb+pLp/X7j79D5ZGu1WOGNArT636xnxQb1rRw==',key_name='tempest-keypair-828280280',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-00d5td73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=aba5a5a4-266b-4511-86ee-258843bd41a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG os_vif [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b853298-92, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b853298-92, col_values=(('external_ids', {'iface-id': '6b853298-921d-44cf-951d-d55fe9364ac3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:85:da', 'vm-uuid': 'aba5a5a4-266b-4511-86ee-258843bd41a5'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:53 user nova-compute[70374]: INFO os_vif [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92')
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-81345c5d-1a24-4244-87a9-7ff428464299 req-3dafb9ba-7b74-4207-b47d-ee3bfb016c19 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-81345c5d-1a24-4244-87a9-7ff428464299 req-3dafb9ba-7b74-4207-b47d-ee3bfb016c19 service nova] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-81345c5d-1a24-4244-87a9-7ff428464299 req-3dafb9ba-7b74-4207-b47d-ee3bfb016c19 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-81345c5d-1a24-4244-87a9-7ff428464299 req-3dafb9ba-7b74-4207-b47d-ee3bfb016c19 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-81345c5d-1a24-4244-87a9-7ff428464299 req-3dafb9ba-7b74-4207-b47d-ee3bfb016c19 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] No waiting events found dispatching network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:53 user nova-compute[70374]: WARNING nova.compute.manager [req-81345c5d-1a24-4244-87a9-7ff428464299 req-3dafb9ba-7b74-4207-b47d-ee3bfb016c19 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received unexpected event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a for instance with vm_state building and task_state spawning.
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] No VIF found with MAC fa:16:3e:16:85:da, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450673.3829892, 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:37:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] VM Resumed (Lifecycle Event)
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:37:53 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance spawned successfully.
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450673.3857944, 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:37:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] VM Started (Lifecycle Event)
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:37:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:37:53 user nova-compute[70374]: INFO nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Took 6.26 seconds to spawn the instance on the hypervisor.
Jul 27 09:37:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:53 user nova-compute[70374]: INFO nova.compute.manager [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Took 7.31 seconds to build instance.
Jul 27 09:37:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f04374fb-0928-4cd9-bd0d-1694008400ee tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.418s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-fb875a6c-cdae-4fd2-ad4a-a9b8d8f483ae req-291e9255-e215-4446-a14e-e3c624b0925d service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fb875a6c-cdae-4fd2-ad4a-a9b8d8f483ae req-291e9255-e215-4446-a14e-e3c624b0925d service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fb875a6c-cdae-4fd2-ad4a-a9b8d8f483ae req-291e9255-e215-4446-a14e-e3c624b0925d service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fb875a6c-cdae-4fd2-ad4a-a9b8d8f483ae req-291e9255-e215-4446-a14e-e3c624b0925d service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-fb875a6c-cdae-4fd2-ad4a-a9b8d8f483ae req-291e9255-e215-4446-a14e-e3c624b0925d service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] No waiting events found dispatching network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:54 user nova-compute[70374]: WARNING nova.compute.manager [req-fb875a6c-cdae-4fd2-ad4a-a9b8d8f483ae req-291e9255-e215-4446-a14e-e3c624b0925d service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received unexpected event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 09:37:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.compute.manager [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450676.9123347, aba5a5a4-266b-4511-86ee-258843bd41a5 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:37:56 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] VM Resumed (Lifecycle Event)
Jul 27 09:37:56 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance spawned successfully.
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-6b7eaa4c-86c3-47b4-ad64-1461f4f73f9d req-6b21ad49-5346-4597-ad48-2fe7cf3264aa service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6b7eaa4c-86c3-47b4-ad64-1461f4f73f9d req-6b21ad49-5346-4597-ad48-2fe7cf3264aa service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6b7eaa4c-86c3-47b4-ad64-1461f4f73f9d req-6b21ad49-5346-4597-ad48-2fe7cf3264aa service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6b7eaa4c-86c3-47b4-ad64-1461f4f73f9d req-6b21ad49-5346-4597-ad48-2fe7cf3264aa service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-6b7eaa4c-86c3-47b4-ad64-1461f4f73f9d req-6b21ad49-5346-4597-ad48-2fe7cf3264aa service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] No waiting events found dispatching network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:37:56 user nova-compute[70374]: WARNING nova.compute.manager [req-6b7eaa4c-86c3-47b4-ad64-1461f4f73f9d req-6b21ad49-5346-4597-ad48-2fe7cf3264aa service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received unexpected event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 09:37:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 09:37:57 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450676.9124658, aba5a5a4-266b-4511-86ee-258843bd41a5 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:37:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] VM Started (Lifecycle Event)
Jul 27 09:37:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:37:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:57 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 09:37:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:37:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:37:57 user nova-compute[70374]: DEBUG nova.objects.instance [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70374) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 09:37:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-320406e8-32cc-40c9-8ca7-8d765d638853 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:37:57 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450662.5932024, e35e780b-67f2-4617-bbc6-45ee7dc92d96 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:37:57 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] VM Stopped (Lifecycle Event)
Jul 27 09:37:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-705d45cb-63e1-4430-b113-c26018299e7c None None] [instance: e35e780b-67f2-4617-bbc6-45ee7dc92d96] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:37:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:37:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-db96d94d-234a-4ba2-830f-1fcc40a7827a req-8b444ae0-91c7-4972-bd76-8923defb9dbe service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-changed-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-db96d94d-234a-4ba2-830f-1fcc40a7827a req-8b444ae0-91c7-4972-bd76-8923defb9dbe service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Refreshing instance network info cache due to event network-changed-ed00f5b8-e247-4240-8030-6bda2ee3ea4e. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-db96d94d-234a-4ba2-830f-1fcc40a7827a req-8b444ae0-91c7-4972-bd76-8923defb9dbe service nova] Acquiring lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-db96d94d-234a-4ba2-830f-1fcc40a7827a req-8b444ae0-91c7-4972-bd76-8923defb9dbe service nova] Acquired lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG nova.network.neutron [req-db96d94d-234a-4ba2-830f-1fcc40a7827a req-8b444ae0-91c7-4972-bd76-8923defb9dbe service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Refreshing network info cache for port ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquired lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'info_cache' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:03 user nova-compute[70374]: INFO nova.compute.manager [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Terminating instance
Jul 27 09:38:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.network.neutron [req-db96d94d-234a-4ba2-830f-1fcc40a7827a req-8b444ae0-91c7-4972-bd76-8923defb9dbe service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updated VIF entry in instance network info cache for port ed00f5b8-e247-4240-8030-6bda2ee3ea4e. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.network.neutron [req-db96d94d-234a-4ba2-830f-1fcc40a7827a req-8b444ae0-91c7-4972-bd76-8923defb9dbe service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updating instance_info_cache with network_info: [{"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-db96d94d-234a-4ba2-830f-1fcc40a7827a req-8b444ae0-91c7-4972-bd76-8923defb9dbe service nova] Releasing lock "refresh_cache-1aac9621-71fc-4779-bc23-097309302b70" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Instance destroyed successfully.
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'resources' on Instance uuid 1aac9621-71fc-4779-bc23-097309302b70 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-995130113',display_name='tempest-TestStampPattern-server-995130113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-995130113',id=18,image_ref='185aa0ef-3c77-4aec-a94f-f256298ecbcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj2SFnPDau6vQCtjDQG1ZxRhv34b+wb9sn5YbvH/SZ654hrAREIUSioV28ip+GznAtPzx4FbU600mwPtKiSdblyqS0Oc7MrVQ7evq+7Ird+40EGlZ1xk19BS7xqljznJA==',key_name='tempest-TestStampPattern-355396374',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b6c645430b147a0983e499772a43790',ramdisk_id='',reservation_id='r-j39c9vcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ea21f129-1e0a-4ad1-b516-c2a8f92835b7',image_min_disk='1',image_min_ram='0',image_owner_id='3b6c645430b147a0983e499772a43790',image_owner_project_name='tempest-TestStampPattern-795018650',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-795018650-project-member',image_user_id='fa672f231aae45d6a68bddddf583dcde',owner_project_name='tempest-TestStampPattern-795018650',owner_user_name='tempest-TestStampPattern-795018650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:17Z,user_data=None,user_id='fa672f231aae45d6a68bddddf583dcde',uuid=1aac9621-71fc-4779-bc23-097309302b70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converting VIF {"id": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "address": "fa:16:3e:8b:28:16", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped00f5b8-e2", "ovs_interfaceid": "ed00f5b8-e247-4240-8030-6bda2ee3ea4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:28:16,bridge_name='br-int',has_traffic_filtering=True,id=ed00f5b8-e247-4240-8030-6bda2ee3ea4e,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped00f5b8-e2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG os_vif [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:28:16,bridge_name='br-int',has_traffic_filtering=True,id=ed00f5b8-e247-4240-8030-6bda2ee3ea4e,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped00f5b8-e2') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped00f5b8-e2, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:04 user nova-compute[70374]: INFO os_vif [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:28:16,bridge_name='br-int',has_traffic_filtering=True,id=ed00f5b8-e247-4240-8030-6bda2ee3ea4e,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped00f5b8-e2')
Jul 27 09:38:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Deleting instance files /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70_del
Jul 27 09:38:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Deletion of /opt/stack/data/nova/instances/1aac9621-71fc-4779-bc23-097309302b70_del complete
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-e5617852-2120-4e80-95f6-ebbc0e1cda6d req-3f85e185-9cab-40c1-a129-806209997727 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-vif-unplugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e5617852-2120-4e80-95f6-ebbc0e1cda6d req-3f85e185-9cab-40c1-a129-806209997727 service nova] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e5617852-2120-4e80-95f6-ebbc0e1cda6d req-3f85e185-9cab-40c1-a129-806209997727 service nova] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e5617852-2120-4e80-95f6-ebbc0e1cda6d req-3f85e185-9cab-40c1-a129-806209997727 service nova] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-e5617852-2120-4e80-95f6-ebbc0e1cda6d req-3f85e185-9cab-40c1-a129-806209997727 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] No waiting events found dispatching network-vif-unplugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-e5617852-2120-4e80-95f6-ebbc0e1cda6d req-3f85e185-9cab-40c1-a129-806209997727 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-vif-unplugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:38:04 user nova-compute[70374]: INFO nova.compute.manager [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 27 09:38:04 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:38:04 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 1aac9621-71fc-4779-bc23-097309302b70] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:05 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Took 0.53 seconds to deallocate network for instance.
Jul 27 09:38:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updating instance_info_cache with network_info: [{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Releasing lock "refresh_cache-25214e8a-c626-46a7-b273-eb491c2fc91b" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:05 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance destroyed successfully.
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'resources' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG os_vif [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb825d9b4-15, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:38:05 user nova-compute[70374]: INFO os_vif [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15')
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Start _get_guest_xml network_info=[{"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'numa_topology' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:38:05 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:38:05 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'pci_devices' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:05 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Deleted allocations for instance 1aac9621-71fc-4779-bc23-097309302b70
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-fd551579-cabf-4bb2-bf3d-06ac18e0bc9b req-fa35f8b0-be46-4009-b26a-4d1aea7213ee service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-vif-deleted-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:38:05 user nova-compute[70374]:   <uuid>25214e8a-c626-46a7-b273-eb491c2fc91b</uuid>
Jul 27 09:38:05 user nova-compute[70374]:   <name>instance-00000006</name>
Jul 27 09:38:05 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:38:05 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:38:05 user nova-compute[70374]:   <metadata>
Jul 27 09:38:05 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:38:05 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:38:05 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeTestJSON-server-1408375692</nova:name>
Jul 27 09:38:05 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:38:05</nova:creationTime>
Jul 27 09:38:05 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:38:05 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:38:05 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:38:05 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:38:05 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:38:05 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:38:05 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:38:05 user nova-compute[70374]:       <nova:owner>
Jul 27 09:38:05 user nova-compute[70374]:         <nova:user uuid="9d4c5ec795ee4d3387ce8718d2ac67e0">tempest-AttachVolumeTestJSON-847846253-project-member</nova:user>
Jul 27 09:38:05 user nova-compute[70374]:         <nova:project uuid="0592f0be670742a181e24823955f378b">tempest-AttachVolumeTestJSON-847846253</nova:project>
Jul 27 09:38:05 user nova-compute[70374]:       </nova:owner>
Jul 27 09:38:05 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:38:05 user nova-compute[70374]:       <nova:ports>
Jul 27 09:38:05 user nova-compute[70374]:         <nova:port uuid="b825d9b4-15c4-4b47-a3f7-af9838d09458">
Jul 27 09:38:05 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 09:38:05 user nova-compute[70374]:         </nova:port>
Jul 27 09:38:05 user nova-compute[70374]:       </nova:ports>
Jul 27 09:38:05 user nova-compute[70374]:     </nova:instance>
Jul 27 09:38:05 user nova-compute[70374]:   </metadata>
Jul 27 09:38:05 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:38:05 user nova-compute[70374]:     <system>
Jul 27 09:38:05 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:38:05 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:38:05 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:38:05 user nova-compute[70374]:       <entry name="serial">25214e8a-c626-46a7-b273-eb491c2fc91b</entry>
Jul 27 09:38:05 user nova-compute[70374]:       <entry name="uuid">25214e8a-c626-46a7-b273-eb491c2fc91b</entry>
Jul 27 09:38:05 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:38:05 user nova-compute[70374]:     </system>
Jul 27 09:38:05 user nova-compute[70374]:   </sysinfo>
Jul 27 09:38:05 user nova-compute[70374]:   <os>
Jul 27 09:38:05 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:38:05 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:38:05 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:38:05 user nova-compute[70374]:   </os>
Jul 27 09:38:05 user nova-compute[70374]:   <features>
Jul 27 09:38:05 user nova-compute[70374]:     <acpi/>
Jul 27 09:38:05 user nova-compute[70374]:     <apic/>
Jul 27 09:38:05 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:38:05 user nova-compute[70374]:   </features>
Jul 27 09:38:05 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:38:05 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:38:05 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:38:05 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:38:05 user nova-compute[70374]:   </clock>
Jul 27 09:38:05 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:38:05 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:38:05 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:38:05 user nova-compute[70374]:   </cpu>
Jul 27 09:38:05 user nova-compute[70374]:   <devices>
Jul 27 09:38:05 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:38:05 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:38:05 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk"/>
Jul 27 09:38:05 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:38:05 user nova-compute[70374]:     </disk>
Jul 27 09:38:05 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:38:05 user nova-compute[70374]:       <mac address="fa:16:3e:b2:af:a6"/>
Jul 27 09:38:05 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:38:05 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:38:05 user nova-compute[70374]:       <target dev="tapb825d9b4-15"/>
Jul 27 09:38:05 user nova-compute[70374]:     </interface>
Jul 27 09:38:05 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:38:05 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/console.log" append="off"/>
Jul 27 09:38:05 user nova-compute[70374]:     </serial>
Jul 27 09:38:05 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:38:05 user nova-compute[70374]:     <video>
Jul 27 09:38:05 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:38:05 user nova-compute[70374]:     </video>
Jul 27 09:38:05 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:38:05 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:38:05 user nova-compute[70374]:     </rng>
Jul 27 09:38:05 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:38:05 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:38:05 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:38:05 user nova-compute[70374]:     </memballoon>
Jul 27 09:38:05 user nova-compute[70374]:   </devices>
Jul 27 09:38:05 user nova-compute[70374]: </domain>
Jul 27 09:38:05 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:38:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9fb0099f-0096-4025-97f7-e56cd7118e07 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "1aac9621-71fc-4779-bc23-097309302b70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.114s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.169s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Cannot resize image /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'migration_context' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG os_vif [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb825d9b4-15, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb825d9b4-15, col_values=(('external_ids', {'iface-id': 'b825d9b4-15c4-4b47-a3f7-af9838d09458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:af:a6', 'vm-uuid': '25214e8a-c626-46a7-b273-eb491c2fc91b'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:06 user nova-compute[70374]: INFO os_vif [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15')
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-e0062b2b-bb6b-44d8-9d82-f96086598d2d req-4ad94647-8cda-452a-ab31-69052c450a87 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received event network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e0062b2b-bb6b-44d8-9d82-f96086598d2d req-4ad94647-8cda-452a-ab31-69052c450a87 service nova] Acquiring lock "1aac9621-71fc-4779-bc23-097309302b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e0062b2b-bb6b-44d8-9d82-f96086598d2d req-4ad94647-8cda-452a-ab31-69052c450a87 service nova] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e0062b2b-bb6b-44d8-9d82-f96086598d2d req-4ad94647-8cda-452a-ab31-69052c450a87 service nova] Lock "1aac9621-71fc-4779-bc23-097309302b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-e0062b2b-bb6b-44d8-9d82-f96086598d2d req-4ad94647-8cda-452a-ab31-69052c450a87 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] No waiting events found dispatching network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:06 user nova-compute[70374]: WARNING nova.compute.manager [req-e0062b2b-bb6b-44d8-9d82-f96086598d2d req-4ad94647-8cda-452a-ab31-69052c450a87 service nova] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Received unexpected event network-vif-plugged-ed00f5b8-e247-4240-8030-6bda2ee3ea4e for instance with vm_state deleted and task_state None.
Jul 27 09:38:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 04a990b9-ed32-41e9-b384-f0886e8d1b49 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:09 user nova-compute[70374]: WARNING nova.compute.manager [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state stopped and task_state powering-on.
Jul 27 09:38:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:09 user nova-compute[70374]: WARNING nova.compute.manager [req-a714fab2-7c8d-41a4-aa89-1272e013f876 req-64d39b94-81c2-4218-b30e-76a30093a47b service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state stopped and task_state powering-on.
Jul 27 09:38:09 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updating instance_info_cache with network_info: [{"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-04a990b9-ed32-41e9-b384-f0886e8d1b49" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450690.3295755, 25214e8a-c626-46a7-b273-eb491c2fc91b => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:38:10 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Resumed (Lifecycle Event)
Jul 27 09:38:10 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance rebooted successfully.
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b6579243-2c2c-49ae-afac-5056ac813f31 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:38:10 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450690.330038, 25214e8a-c626-46a7-b273-eb491c2fc91b => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:38:10 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Started (Lifecycle Event)
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:14 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:38:14 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7217MB free_disk=25.409873962402344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 30aa3eca-5c9f-443a-af70-461010d4e22e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance aba5a5a4-266b-4511-86ee-258843bd41a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 69a59942-cd83-4f74-82ea-f23a6538cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ab9c2cd8-7137-4921-b014-5a516da0e249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:38:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:19 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450684.7750144, 1aac9621-71fc-4779-bc23-097309302b70 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:38:19 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 1aac9621-71fc-4779-bc23-097309302b70] VM Stopped (Lifecycle Event)
Jul 27 09:38:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d7e60c29-2938-4967-a40e-235dd3c9de5e None None] [instance: 1aac9621-71fc-4779-bc23-097309302b70] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "3070aa19-a0a5-40a1-a697-727da1c1cf61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:38:34 user nova-compute[70374]: INFO nova.compute.claims [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Claim successful on node user
Jul 27 09:38:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:38:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:38:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Creating image(s)
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "/opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "/opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "/opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.policy [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dfadf5215e24c45a8f55022e1cda47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '856989e8171645fc9a6e6c1cbb2358fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.199s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk 1073741824" returned: 0 in 0.075s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.157s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Cannot resize image /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lazy-loading 'migration_context' on Instance uuid 3070aa19-a0a5-40a1-a697-727da1c1cf61 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Ensure instance console log exists: /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:36 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Successfully created port: b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:38:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Successfully updated port: b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "refresh_cache-3070aa19-a0a5-40a1-a697-727da1c1cf61" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquired lock "refresh_cache-3070aa19-a0a5-40a1-a697-727da1c1cf61" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:38:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-d7a2f129-aa63-4c04-96f3-d5f87b58fbb1 req-b31215a4-9d1b-4698-91f0-108d0f86fddb service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received event network-changed-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-d7a2f129-aa63-4c04-96f3-d5f87b58fbb1 req-b31215a4-9d1b-4698-91f0-108d0f86fddb service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Refreshing instance network info cache due to event network-changed-b348d47c-07f5-4d08-a9de-d066adb8116e. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d7a2f129-aa63-4c04-96f3-d5f87b58fbb1 req-b31215a4-9d1b-4698-91f0-108d0f86fddb service nova] Acquiring lock "refresh_cache-3070aa19-a0a5-40a1-a697-727da1c1cf61" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Updating instance_info_cache with network_info: [{"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Releasing lock "refresh_cache-3070aa19-a0a5-40a1-a697-727da1c1cf61" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Instance network_info: |[{"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d7a2f129-aa63-4c04-96f3-d5f87b58fbb1 req-b31215a4-9d1b-4698-91f0-108d0f86fddb service nova] Acquired lock "refresh_cache-3070aa19-a0a5-40a1-a697-727da1c1cf61" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-d7a2f129-aa63-4c04-96f3-d5f87b58fbb1 req-b31215a4-9d1b-4698-91f0-108d0f86fddb service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Refreshing network info cache for port b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Start _get_guest_xml network_info=[{"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:38:38 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:38:38 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-868883367',display_name='tempest-VolumesActionsTest-instance-868883367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-868883367',id=24,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='856989e8171645fc9a6e6c1cbb2358fb',ramdisk_id='',reservation_id='r-vytepbla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1348517842',owner_user_name='tempest-VolumesActionsTest-1348517842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:35Z,user_data=None,user_id='7dfadf5215e24c45a8f55022e1cda47b',uuid=3070aa19-a0a5-40a1-a697-727da1c1cf61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converting VIF {"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:22:7e,bridge_name='br-int',has_traffic_filtering=True,id=b348d47c-07f5-4d08-a9de-d066adb8116e,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb348d47c-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lazy-loading 'pci_devices' on Instance uuid 3070aa19-a0a5-40a1-a697-727da1c1cf61 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:38:38 user nova-compute[70374]:   <uuid>3070aa19-a0a5-40a1-a697-727da1c1cf61</uuid>
Jul 27 09:38:38 user nova-compute[70374]:   <name>instance-00000018</name>
Jul 27 09:38:38 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:38:38 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:38:38 user nova-compute[70374]:   <metadata>
Jul 27 09:38:38 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:38:38 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:38:38 user nova-compute[70374]:       <nova:name>tempest-VolumesActionsTest-instance-868883367</nova:name>
Jul 27 09:38:38 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:38:38</nova:creationTime>
Jul 27 09:38:38 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:38:38 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:38:38 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:38:38 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:38:38 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:38:38 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:38:38 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:38:38 user nova-compute[70374]:       <nova:owner>
Jul 27 09:38:38 user nova-compute[70374]:         <nova:user uuid="7dfadf5215e24c45a8f55022e1cda47b">tempest-VolumesActionsTest-1348517842-project-member</nova:user>
Jul 27 09:38:38 user nova-compute[70374]:         <nova:project uuid="856989e8171645fc9a6e6c1cbb2358fb">tempest-VolumesActionsTest-1348517842</nova:project>
Jul 27 09:38:38 user nova-compute[70374]:       </nova:owner>
Jul 27 09:38:38 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:38:38 user nova-compute[70374]:       <nova:ports>
Jul 27 09:38:38 user nova-compute[70374]:         <nova:port uuid="b348d47c-07f5-4d08-a9de-d066adb8116e">
Jul 27 09:38:38 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 09:38:38 user nova-compute[70374]:         </nova:port>
Jul 27 09:38:38 user nova-compute[70374]:       </nova:ports>
Jul 27 09:38:38 user nova-compute[70374]:     </nova:instance>
Jul 27 09:38:38 user nova-compute[70374]:   </metadata>
Jul 27 09:38:38 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:38:38 user nova-compute[70374]:     <system>
Jul 27 09:38:38 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:38:38 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:38:38 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:38:38 user nova-compute[70374]:       <entry name="serial">3070aa19-a0a5-40a1-a697-727da1c1cf61</entry>
Jul 27 09:38:38 user nova-compute[70374]:       <entry name="uuid">3070aa19-a0a5-40a1-a697-727da1c1cf61</entry>
Jul 27 09:38:38 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:38:38 user nova-compute[70374]:     </system>
Jul 27 09:38:38 user nova-compute[70374]:   </sysinfo>
Jul 27 09:38:38 user nova-compute[70374]:   <os>
Jul 27 09:38:38 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:38:38 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:38:38 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:38:38 user nova-compute[70374]:   </os>
Jul 27 09:38:38 user nova-compute[70374]:   <features>
Jul 27 09:38:38 user nova-compute[70374]:     <acpi/>
Jul 27 09:38:38 user nova-compute[70374]:     <apic/>
Jul 27 09:38:38 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:38:38 user nova-compute[70374]:   </features>
Jul 27 09:38:38 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:38:38 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:38:38 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:38:38 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:38:38 user nova-compute[70374]:   </clock>
Jul 27 09:38:38 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:38:38 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:38:38 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:38:38 user nova-compute[70374]:   </cpu>
Jul 27 09:38:38 user nova-compute[70374]:   <devices>
Jul 27 09:38:38 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:38:38 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:38:38 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk"/>
Jul 27 09:38:38 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:38:38 user nova-compute[70374]:     </disk>
Jul 27 09:38:38 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:38:38 user nova-compute[70374]:       <mac address="fa:16:3e:c8:22:7e"/>
Jul 27 09:38:38 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:38:38 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:38:38 user nova-compute[70374]:       <target dev="tapb348d47c-07"/>
Jul 27 09:38:38 user nova-compute[70374]:     </interface>
Jul 27 09:38:38 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:38:38 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/console.log" append="off"/>
Jul 27 09:38:38 user nova-compute[70374]:     </serial>
Jul 27 09:38:38 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:38:38 user nova-compute[70374]:     <video>
Jul 27 09:38:38 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:38:38 user nova-compute[70374]:     </video>
Jul 27 09:38:38 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:38:38 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:38:38 user nova-compute[70374]:     </rng>
Jul 27 09:38:38 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:38:38 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:38:38 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:38:38 user nova-compute[70374]:     </memballoon>
Jul 27 09:38:38 user nova-compute[70374]:   </devices>
Jul 27 09:38:38 user nova-compute[70374]: </domain>
Jul 27 09:38:38 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-868883367',display_name='tempest-VolumesActionsTest-instance-868883367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-868883367',id=24,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='856989e8171645fc9a6e6c1cbb2358fb',ramdisk_id='',reservation_id='r-vytepbla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1348517842',owner_user_name='tempest-VolumesActionsTest-1348517842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:35Z,user_data=None,user_id='7dfadf5215e24c45a8f55022e1cda47b',uuid=3070aa19-a0a5-40a1-a697-727da1c1cf61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converting VIF {"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:22:7e,bridge_name='br-int',has_traffic_filtering=True,id=b348d47c-07f5-4d08-a9de-d066adb8116e,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb348d47c-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG os_vif [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:22:7e,bridge_name='br-int',has_traffic_filtering=True,id=b348d47c-07f5-4d08-a9de-d066adb8116e,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb348d47c-07') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb348d47c-07, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb348d47c-07, col_values=(('external_ids', {'iface-id': 'b348d47c-07f5-4d08-a9de-d066adb8116e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:22:7e', 'vm-uuid': '3070aa19-a0a5-40a1-a697-727da1c1cf61'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:38 user nova-compute[70374]: INFO os_vif [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:22:7e,bridge_name='br-int',has_traffic_filtering=True,id=b348d47c-07f5-4d08-a9de-d066adb8116e,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb348d47c-07')
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] No VIF found with MAC fa:16:3e:c8:22:7e, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-d7a2f129-aa63-4c04-96f3-d5f87b58fbb1 req-b31215a4-9d1b-4698-91f0-108d0f86fddb service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Updated VIF entry in instance network info cache for port b348d47c-07f5-4d08-a9de-d066adb8116e. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-d7a2f129-aa63-4c04-96f3-d5f87b58fbb1 req-b31215a4-9d1b-4698-91f0-108d0f86fddb service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Updating instance_info_cache with network_info: [{"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d7a2f129-aa63-4c04-96f3-d5f87b58fbb1 req-b31215a4-9d1b-4698-91f0-108d0f86fddb service nova] Releasing lock "refresh_cache-3070aa19-a0a5-40a1-a697-727da1c1cf61" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-11398de3-6197-4cea-8fdc-2cc7288fe0c8 req-20aa2150-26a2-4c5b-9d05-cb883e5d59bf service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received event network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-11398de3-6197-4cea-8fdc-2cc7288fe0c8 req-20aa2150-26a2-4c5b-9d05-cb883e5d59bf service nova] Acquiring lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-11398de3-6197-4cea-8fdc-2cc7288fe0c8 req-20aa2150-26a2-4c5b-9d05-cb883e5d59bf service nova] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-11398de3-6197-4cea-8fdc-2cc7288fe0c8 req-20aa2150-26a2-4c5b-9d05-cb883e5d59bf service nova] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-11398de3-6197-4cea-8fdc-2cc7288fe0c8 req-20aa2150-26a2-4c5b-9d05-cb883e5d59bf service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] No waiting events found dispatching network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:40 user nova-compute[70374]: WARNING nova.compute.manager [req-11398de3-6197-4cea-8fdc-2cc7288fe0c8 req-20aa2150-26a2-4c5b-9d05-cb883e5d59bf service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received unexpected event network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e for instance with vm_state building and task_state spawning.
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450721.6646934, 3070aa19-a0a5-40a1-a697-727da1c1cf61 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:38:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] VM Resumed (Lifecycle Event)
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:38:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Instance spawned successfully.
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450721.6660883, 3070aa19-a0a5-40a1-a697-727da1c1cf61 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:38:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] VM Started (Lifecycle Event)
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:38:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:38:41 user nova-compute[70374]: INFO nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Took 6.61 seconds to spawn the instance on the hypervisor.
Jul 27 09:38:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:41 user nova-compute[70374]: INFO nova.compute.manager [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Took 7.45 seconds to build instance.
Jul 27 09:38:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6a350d4c-23e1-4429-9f58-663314f8da62 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.548s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "27316e38-df5e-433e-bd67-719ea7caeab4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:38:42 user nova-compute[70374]: INFO nova.compute.claims [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Claim successful on node user
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-335eeded-8687-4a77-9996-963f7b800ba1 req-4b4fba97-833b-4e31-ad8e-62221dcb12e8 service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received event network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-335eeded-8687-4a77-9996-963f7b800ba1 req-4b4fba97-833b-4e31-ad8e-62221dcb12e8 service nova] Acquiring lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-335eeded-8687-4a77-9996-963f7b800ba1 req-4b4fba97-833b-4e31-ad8e-62221dcb12e8 service nova] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-335eeded-8687-4a77-9996-963f7b800ba1 req-4b4fba97-833b-4e31-ad8e-62221dcb12e8 service nova] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-335eeded-8687-4a77-9996-963f7b800ba1 req-4b4fba97-833b-4e31-ad8e-62221dcb12e8 service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] No waiting events found dispatching network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:42 user nova-compute[70374]: WARNING nova.compute.manager [req-335eeded-8687-4a77-9996-963f7b800ba1 req-4b4fba97-833b-4e31-ad8e-62221dcb12e8 service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received unexpected event network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e for instance with vm_state active and task_state None.
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:38:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:38:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:38:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:38:43 user nova-compute[70374]: INFO nova.virt.block_device [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Booting with volume c858282f-5798-4275-98d4-8b5a5a8e7ac5 at /dev/vda
Jul 27 09:38:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG nova.policy [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0edfda9256e04349bf903c0d13168ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64a77073d6849c2a31d4acd7eb389eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG os_brick.utils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cdd89c-8169-4dea-8d2a-123274587414]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2529c1eb-53fe-45af-b0df-ded5200df4af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3344d30-adf1-4080-8b23-ade0b0c3c76d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[af826a13-3af8-4e02-b127-f50db38c5178]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:38:43 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:38:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff5f51-3804-4013-83fb-e1ef0b1c7ee0]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG os_brick.utils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating existing volume attachment record: fc8c0b06-f856-4137-b0b7-1115fe950c9f {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:43 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully created port: 6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:38:44 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully created port: 296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:38:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully created port: ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully created port: b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:38:46 user nova-compute[70374]: INFO nova.compute.claims [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Claim successful on node user
Jul 27 09:38:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-f5c43f29-1e0c-4e90-a7eb-72a57dd35c8f req-0f8e8db1-0378-43aa-954d-87f03eb4d2db service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received event network-changed-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-f5c43f29-1e0c-4e90-a7eb-72a57dd35c8f req-0f8e8db1-0378-43aa-954d-87f03eb4d2db service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Refreshing instance network info cache due to event network-changed-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f5c43f29-1e0c-4e90-a7eb-72a57dd35c8f req-0f8e8db1-0378-43aa-954d-87f03eb4d2db service nova] Acquiring lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f5c43f29-1e0c-4e90-a7eb-72a57dd35c8f req-0f8e8db1-0378-43aa-954d-87f03eb4d2db service nova] Acquired lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:46 user nova-compute[70374]: DEBUG nova.network.neutron [req-f5c43f29-1e0c-4e90-a7eb-72a57dd35c8f req-0f8e8db1-0378-43aa-954d-87f03eb4d2db service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Refreshing network info cache for port 407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully created port: 18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.844s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:38:47 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-f5c43f29-1e0c-4e90-a7eb-72a57dd35c8f req-0f8e8db1-0378-43aa-954d-87f03eb4d2db service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Updated VIF entry in instance network info cache for port 407194e8-45f0-4dc4-89ab-f9ed8a4fdbed. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-f5c43f29-1e0c-4e90-a7eb-72a57dd35c8f req-0f8e8db1-0378-43aa-954d-87f03eb4d2db service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Updating instance_info_cache with network_info: [{"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f5c43f29-1e0c-4e90-a7eb-72a57dd35c8f req-0f8e8db1-0378-43aa-954d-87f03eb4d2db service nova] Releasing lock "refresh_cache-ab9c2cd8-7137-4921-b014-5a516da0e249" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:38:47 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Creating image(s)
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.170s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:47 user nova-compute[70374]: DEBUG nova.policy [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd059c8dff3644f3c9c0c54498a4d78f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8acda82ef3f428fbb93847922a213d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk 1073741824" returned: 0 in 0.062s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Cannot resize image /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'migration_context' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Ensure instance console log exists: /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully updated port: 6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-a059ec6c-0876-431d-9206-0c93c9f44aae req-b6b862b4-af4d-4be2-803f-56f4e9f67fc0 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-changed-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-a059ec6c-0876-431d-9206-0c93c9f44aae req-b6b862b4-af4d-4be2-803f-56f4e9f67fc0 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing instance network info cache due to event network-changed-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a059ec6c-0876-431d-9206-0c93c9f44aae req-b6b862b4-af4d-4be2-803f-56f4e9f67fc0 service nova] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a059ec6c-0876-431d-9206-0c93c9f44aae req-b6b862b4-af4d-4be2-803f-56f4e9f67fc0 service nova] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG nova.network.neutron [req-a059ec6c-0876-431d-9206-0c93c9f44aae req-b6b862b4-af4d-4be2-803f-56f4e9f67fc0 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing network info cache for port 6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Successfully created port: c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG nova.network.neutron [req-a059ec6c-0876-431d-9206-0c93c9f44aae req-b6b862b4-af4d-4be2-803f-56f4e9f67fc0 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG nova.network.neutron [req-a059ec6c-0876-431d-9206-0c93c9f44aae req-b6b862b4-af4d-4be2-803f-56f4e9f67fc0 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a059ec6c-0876-431d-9206-0c93c9f44aae req-b6b862b4-af4d-4be2-803f-56f4e9f67fc0 service nova] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully updated port: e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Successfully updated port: c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquired lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid ab9c2cd8-7137-4921-b014-5a516da0e249 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:51 user nova-compute[70374]: INFO nova.virt.block_device [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Booting with volume c42b0d80-658e-4dbd-b383-80edaea79aed at /dev/vdb
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:51 user nova-compute[70374]: INFO nova.compute.manager [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Attaching volume e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c to /dev/vdb
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.utils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.utils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f87c2dc-4d28-4637-a400-62a212323a30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-changed-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing instance network info cache due to event network-changed-e82a7a06-2db3-48f1-883e-2253df574d5e. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing network info cache for port e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8565ec-17e0-4efc-95cb-9260c2fa94b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd705b5-95cd-40c6-80c5-dcebf59056e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf5bd8d-b21c-4d87-9774-034c41f60b82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d64a913-e2a6-42de-9690-5c8eaa16bbca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d11773-05d0-4c21-b16a-600ab72722ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d1bdc8-5371-4503-a11f-4817ad74456f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3ee01e-b7d7-4ff6-ac7f-eec6ab33ad71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:38:51 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[65688654-a469-4c9f-b310-b3a883c3d162]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Releasing lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance network_info: |[{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.utils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating existing volume attachment record: 5dd9900e-67e6-47d3-98af-8484093a195e {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Start _get_guest_xml network_info=[{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:38:51 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f7ec1b-6b82-4b36-8a2f-bed984b6e2f7]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_brick.utils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== get_connector_properties: return (258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Updating existing volume attachment record: d86c9fe1-19a3-48a5-a933-2647974bd495 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:38:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:38:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1128759625',display_name='tempest-ServerRescueNegativeTestJSON-server-1128759625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1128759625',id=26,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZj+k3Bgy7oCtHJzEs2H3+NxtBrthZmd6r3Jc2RDUxkkti9jy66392CRnCtb3zi3qP5p5VGM/NEkUBAuG/ZEYZAP/D4yV5s2fCbg7QBbglGQvwL3bBpZRdJLzIVLbkOqA==',key_name='tempest-keypair-601043870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-a1q2nab0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=66911d11-4025-4243-9f8e-ff0909460190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c5e7d75d-7b90-4a67-a548-f829c290e294,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e7d75d-7b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'pci_devices' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:38:51 user nova-compute[70374]:   <uuid>66911d11-4025-4243-9f8e-ff0909460190</uuid>
Jul 27 09:38:51 user nova-compute[70374]:   <name>instance-0000001a</name>
Jul 27 09:38:51 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:38:51 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:38:51 user nova-compute[70374]:   <metadata>
Jul 27 09:38:51 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:38:51 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:38:51 user nova-compute[70374]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1128759625</nova:name>
Jul 27 09:38:51 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:38:51</nova:creationTime>
Jul 27 09:38:51 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:38:51 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:38:51 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:38:51 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:38:51 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:38:51 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:38:51 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:38:51 user nova-compute[70374]:       <nova:owner>
Jul 27 09:38:51 user nova-compute[70374]:         <nova:user uuid="d059c8dff3644f3c9c0c54498a4d78f7">tempest-ServerRescueNegativeTestJSON-241559119-project-member</nova:user>
Jul 27 09:38:51 user nova-compute[70374]:         <nova:project uuid="d8acda82ef3f428fbb93847922a213d1">tempest-ServerRescueNegativeTestJSON-241559119</nova:project>
Jul 27 09:38:51 user nova-compute[70374]:       </nova:owner>
Jul 27 09:38:51 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:38:51 user nova-compute[70374]:       <nova:ports>
Jul 27 09:38:51 user nova-compute[70374]:         <nova:port uuid="c5e7d75d-7b90-4a67-a548-f829c290e294">
Jul 27 09:38:51 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 09:38:51 user nova-compute[70374]:         </nova:port>
Jul 27 09:38:51 user nova-compute[70374]:       </nova:ports>
Jul 27 09:38:51 user nova-compute[70374]:     </nova:instance>
Jul 27 09:38:51 user nova-compute[70374]:   </metadata>
Jul 27 09:38:51 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:38:51 user nova-compute[70374]:     <system>
Jul 27 09:38:51 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:38:51 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:38:51 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:38:51 user nova-compute[70374]:       <entry name="serial">66911d11-4025-4243-9f8e-ff0909460190</entry>
Jul 27 09:38:51 user nova-compute[70374]:       <entry name="uuid">66911d11-4025-4243-9f8e-ff0909460190</entry>
Jul 27 09:38:51 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:38:51 user nova-compute[70374]:     </system>
Jul 27 09:38:51 user nova-compute[70374]:   </sysinfo>
Jul 27 09:38:51 user nova-compute[70374]:   <os>
Jul 27 09:38:51 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:38:51 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:38:51 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:38:51 user nova-compute[70374]:   </os>
Jul 27 09:38:51 user nova-compute[70374]:   <features>
Jul 27 09:38:51 user nova-compute[70374]:     <acpi/>
Jul 27 09:38:51 user nova-compute[70374]:     <apic/>
Jul 27 09:38:51 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:38:51 user nova-compute[70374]:   </features>
Jul 27 09:38:51 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:38:51 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:38:51 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:38:51 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:38:51 user nova-compute[70374]:   </clock>
Jul 27 09:38:51 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:38:51 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:38:51 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:38:51 user nova-compute[70374]:   </cpu>
Jul 27 09:38:51 user nova-compute[70374]:   <devices>
Jul 27 09:38:51 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:38:51 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:38:51 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk"/>
Jul 27 09:38:51 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:38:51 user nova-compute[70374]:     </disk>
Jul 27 09:38:51 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:38:51 user nova-compute[70374]:       <mac address="fa:16:3e:02:4c:b3"/>
Jul 27 09:38:51 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:38:51 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:38:51 user nova-compute[70374]:       <target dev="tapc5e7d75d-7b"/>
Jul 27 09:38:51 user nova-compute[70374]:     </interface>
Jul 27 09:38:51 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:38:51 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/console.log" append="off"/>
Jul 27 09:38:51 user nova-compute[70374]:     </serial>
Jul 27 09:38:51 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:38:51 user nova-compute[70374]:     <video>
Jul 27 09:38:51 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:38:51 user nova-compute[70374]:     </video>
Jul 27 09:38:51 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:38:51 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:38:51 user nova-compute[70374]:     </rng>
Jul 27 09:38:51 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:38:51 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:38:51 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:38:51 user nova-compute[70374]:     </memballoon>
Jul 27 09:38:51 user nova-compute[70374]:   </devices>
Jul 27 09:38:51 user nova-compute[70374]: </domain>
Jul 27 09:38:51 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1128759625',display_name='tempest-ServerRescueNegativeTestJSON-server-1128759625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1128759625',id=26,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZj+k3Bgy7oCtHJzEs2H3+NxtBrthZmd6r3Jc2RDUxkkti9jy66392CRnCtb3zi3qP5p5VGM/NEkUBAuG/ZEYZAP/D4yV5s2fCbg7QBbglGQvwL3bBpZRdJLzIVLbkOqA==',key_name='tempest-keypair-601043870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-a1q2nab0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=66911d11-4025-4243-9f8e-ff0909460190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c5e7d75d-7b90-4a67-a548-f829c290e294,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e7d75d-7b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG os_vif [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c5e7d75d-7b90-4a67-a548-f829c290e294,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e7d75d-7b') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e7d75d-7b, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5e7d75d-7b, col_values=(('external_ids', {'iface-id': 'c5e7d75d-7b90-4a67-a548-f829c290e294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:4c:b3', 'vm-uuid': '66911d11-4025-4243-9f8e-ff0909460190'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:51 user nova-compute[70374]: INFO os_vif [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c5e7d75d-7b90-4a67-a548-f829c290e294,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e7d75d-7b')
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-changed-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Refreshing instance network info cache due to event network-changed-c5e7d75d-7b90-4a67-a548-f829c290e294. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] Acquiring lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] Acquired lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Refreshing network info cache for port c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No VIF found with MAC fa:16:3e:02:4c:b3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:38:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully updated port: fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updated VIF entry in instance network info cache for port c5e7d75d-7b90-4a67-a548-f829c290e294. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:38:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8c0928d9-6a77-4a73-8246-132e560c4993 req-6f92450d-149d-4916-a18a-2e7fe9bb5ca8 service nova] Releasing lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully updated port: 296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-changed-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing instance network info cache due to event network-changed-fd818b43-d661-467a-b885-7a67f78bc578. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing network info cache for port fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-6bec4d92-3789-42a2-9b59-50fd03add024 req-3be97bfd-0ecd-40c3-822c-3d383a51995c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6bec4d92-3789-42a2-9b59-50fd03add024 req-3be97bfd-0ecd-40c3-822c-3d383a51995c service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6bec4d92-3789-42a2-9b59-50fd03add024 req-3be97bfd-0ecd-40c3-822c-3d383a51995c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6bec4d92-3789-42a2-9b59-50fd03add024 req-3be97bfd-0ecd-40c3-822c-3d383a51995c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-6bec4d92-3789-42a2-9b59-50fd03add024 req-3be97bfd-0ecd-40c3-822c-3d383a51995c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:53 user nova-compute[70374]: WARNING nova.compute.manager [req-6bec4d92-3789-42a2-9b59-50fd03add024 req-3be97bfd-0ecd-40c3-822c-3d383a51995c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state building and task_state spawning.
Jul 27 09:38:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-changed-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing instance network info cache due to event network-changed-296190d8-e4e1-4d98-9c48-b588d5fa4157. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing network info cache for port 296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:53 user nova-compute[70374]: DEBUG nova.network.neutron [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:54 user nova-compute[70374]: DEBUG nova.network.neutron [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f67e27a1-f821-4736-91ad-66c822c6a29d req-320b3e71-ea7f-40b9-94c6-db46c119b914 service nova] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully updated port: ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-12e83155-e9d7-4603-99a5-3e77b24d4881 req-940d166d-2f91-4cf9-8cd8-294c2bab8379 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-changed-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-12e83155-e9d7-4603-99a5-3e77b24d4881 req-940d166d-2f91-4cf9-8cd8-294c2bab8379 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing instance network info cache due to event network-changed-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-12e83155-e9d7-4603-99a5-3e77b24d4881 req-940d166d-2f91-4cf9-8cd8-294c2bab8379 service nova] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-12e83155-e9d7-4603-99a5-3e77b24d4881 req-940d166d-2f91-4cf9-8cd8-294c2bab8379 service nova] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-12e83155-e9d7-4603-99a5-3e77b24d4881 req-940d166d-2f91-4cf9-8cd8-294c2bab8379 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing network info cache for port ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-09e99a83-ad14-4872-9a08-8c5782365252 req-8c3bfac8-345b-424c-b7c3-d1890bbc1c63 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-09e99a83-ad14-4872-9a08-8c5782365252 req-8c3bfac8-345b-424c-b7c3-d1890bbc1c63 service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-09e99a83-ad14-4872-9a08-8c5782365252 req-8c3bfac8-345b-424c-b7c3-d1890bbc1c63 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-09e99a83-ad14-4872-9a08-8c5782365252 req-8c3bfac8-345b-424c-b7c3-d1890bbc1c63 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-09e99a83-ad14-4872-9a08-8c5782365252 req-8c3bfac8-345b-424c-b7c3-d1890bbc1c63 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:55 user nova-compute[70374]: WARNING nova.compute.manager [req-09e99a83-ad14-4872-9a08-8c5782365252 req-8c3bfac8-345b-424c-b7c3-d1890bbc1c63 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state building and task_state spawning.
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-12e83155-e9d7-4603-99a5-3e77b24d4881 req-940d166d-2f91-4cf9-8cd8-294c2bab8379 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450735.847957, 66911d11-4025-4243-9f8e-ff0909460190 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:38:55 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] VM Resumed (Lifecycle Event)
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:38:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance spawned successfully.
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:38:55 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450735.8550527, 66911d11-4025-4243-9f8e-ff0909460190 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:38:55 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] VM Started (Lifecycle Event)
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-12e83155-e9d7-4603-99a5-3e77b24d4881 req-940d166d-2f91-4cf9-8cd8-294c2bab8379 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-12e83155-e9d7-4603-99a5-3e77b24d4881 req-940d166d-2f91-4cf9-8cd8-294c2bab8379 service nova] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:38:56 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:38:56 user nova-compute[70374]: INFO nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Took 8.39 seconds to spawn the instance on the hypervisor.
Jul 27 09:38:56 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:38:56 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully updated port: b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:56 user nova-compute[70374]: INFO nova.compute.manager [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Took 9.69 seconds to build instance.
Jul 27 09:38:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7959c09f-220e-4425-9e33-89c0457f621f tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.802s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-42103614-27bc-40c2-9c7e-f04bce3144ed req-e7ddd9e3-b8c2-4935-9319-52eee89c9b0e service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-changed-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-42103614-27bc-40c2-9c7e-f04bce3144ed req-e7ddd9e3-b8c2-4935-9319-52eee89c9b0e service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing instance network info cache due to event network-changed-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-42103614-27bc-40c2-9c7e-f04bce3144ed req-e7ddd9e3-b8c2-4935-9319-52eee89c9b0e service nova] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-42103614-27bc-40c2-9c7e-f04bce3144ed req-e7ddd9e3-b8c2-4935-9319-52eee89c9b0e service nova] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-42103614-27bc-40c2-9c7e-f04bce3144ed req-e7ddd9e3-b8c2-4935-9319-52eee89c9b0e service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing network info cache for port b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-42103614-27bc-40c2-9c7e-f04bce3144ed req-e7ddd9e3-b8c2-4935-9319-52eee89c9b0e service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Successfully updated port: 18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-42103614-27bc-40c2-9c7e-f04bce3144ed req-e7ddd9e3-b8c2-4935-9319-52eee89c9b0e service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-42103614-27bc-40c2-9c7e-f04bce3144ed req-e7ddd9e3-b8c2-4935-9319-52eee89c9b0e service nova] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:38:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:38:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:58 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:38:58 user nova-compute[70374]: INFO nova.compute.claims [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Claim successful on node user
Jul 27 09:38:58 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:38:58 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:38:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.823s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:38:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.policy [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce8d942c3b93453bafa8381f39ec85a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d47c627f4a94472a80b922a262aa172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:38:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Creating image(s)
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "/opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "/opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:59 user nova-compute[70374]: INFO nova.compute.manager [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Terminating instance
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.189s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-48432c68-d3b9-46d1-a11f-f76169ef7f76 req-89d97e47-a5d1-4d9f-96e1-0830c11822d6 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-changed-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-48432c68-d3b9-46d1-a11f-f76169ef7f76 req-89d97e47-a5d1-4d9f-96e1-0830c11822d6 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing instance network info cache due to event network-changed-18cc95e6-69da-48ba-a8f0-069677e917ad. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48432c68-d3b9-46d1-a11f-f76169ef7f76 req-89d97e47-a5d1-4d9f-96e1-0830c11822d6 service nova] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.217s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-96c0c2b6-036d-4162-849d-6701a8011042 req-2c492d63-b0e6-4239-92a2-517acd59a8f9 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received event network-vif-unplugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96c0c2b6-036d-4162-849d-6701a8011042 req-2c492d63-b0e6-4239-92a2-517acd59a8f9 service nova] Acquiring lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96c0c2b6-036d-4162-849d-6701a8011042 req-2c492d63-b0e6-4239-92a2-517acd59a8f9 service nova] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-96c0c2b6-036d-4162-849d-6701a8011042 req-2c492d63-b0e6-4239-92a2-517acd59a8f9 service nova] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-96c0c2b6-036d-4162-849d-6701a8011042 req-2c492d63-b0e6-4239-92a2-517acd59a8f9 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] No waiting events found dispatching network-vif-unplugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-96c0c2b6-036d-4162-849d-6701a8011042 req-2c492d63-b0e6-4239-92a2-517acd59a8f9 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received event network-vif-unplugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk 1073741824" returned: 0 in 0.102s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:38:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqVXhoGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:00 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.235s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[165bf249-3f41-4844-902c-fbad054c9a8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:39:00 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfae6097-c052-480e-b578-a0f81a56b19c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c] added
Jul 27 09:39:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6725d1f4-0d87-43ad-8171-2f7b581eef3c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a69ff-77da-49ec-bb7e-45f8338bef6a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqVXhoGE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Instance destroyed successfully.
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lazy-loading 'resources' on Instance uuid 04a990b9-ed32-41e9-b384-f0886e8d1b49 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Cannot resize image /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'migration_context' on Instance uuid f6f417a6-c890-4372-8471-099eae592990 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-503176185',display_name='tempest-ServersNegativeTestJSON-server-503176185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-503176185',id=1,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65e935bb36794aa98eb3e94c30e647d9',ramdisk_id='',reservation_id='r-xsrj9cxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1865798359',owner_user_name='tempest-ServersNegativeTestJSON-1865798359-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:30:24Z,user_data=None,user_id='544aa4a40ff941c2a52b24faa08a0d29',uuid=04a990b9-ed32-41e9-b384-f0886e8d1b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converting VIF {"id": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "address": "fa:16:3e:e6:e0:42", "network": {"id": "e1a0003b-0f63-4efa-9d24-933f88eb0373", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-651468270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65e935bb36794aa98eb3e94c30e647d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6858719a-7f", "ovs_interfaceid": "6858719a-7fa4-4a64-ad8a-02c9274adb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e0:42,bridge_name='br-int',has_traffic_filtering=True,id=6858719a-7fa4-4a64-ad8a-02c9274adb55,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6858719a-7f') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_vif [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e0:42,bridge_name='br-int',has_traffic_filtering=True,id=6858719a-7fa4-4a64-ad8a-02c9274adb55,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6858719a-7f') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Ensure instance console log exists: /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqVXhoGE" returned: 0 in 0.032s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb88c2-e4a8-44b4-a6de-92179b1da940]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqVXhoGE'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6858719a-7f, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:00 user nova-compute[70374]: INFO os_vif [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e0:42,bridge_name='br-int',has_traffic_filtering=True,id=6858719a-7fa4-4a64-ad8a-02c9274adb55,network=Network(e1a0003b-0f63-4efa-9d24-933f88eb0373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6858719a-7f')
Jul 27 09:39:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Deleting instance files /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49_del
Jul 27 09:39:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Deletion of /opt/stack/data/nova/instances/04a990b9-ed32-41e9-b384-f0886e8d1b49_del complete
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e721ad-da00-4ade-bee7-bbfbb1159540]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ae410f-b0d7-4e82-880a-117904d1bd23]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: INFO nova.compute.manager [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f741210-46a2-4d87-ab1c-9d8eb6a9f0a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c, portal: 172.16.0.220,3260]
Jul 27 09:39:00 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c, portal: 172.16.0.220,3260] successful.
Jul 27 09:39:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f422b-755f-4835-aec7-d94f7e19affb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d5467f-3350-4a1b-b15d-a1b8a7604f02]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:00 user nova-compute[70374]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c (non-flash)
Jul 27 09:39:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:00 user nova-compute[70374]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c (non-flash)
Jul 27 09:39:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[875c66ef-9c57-432f-9f5f-8f0d80657c7a]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqVXhoGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:39:00 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Successfully created port: c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.network.neutron [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [{"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance network_info: |[{"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48432c68-d3b9-46d1-a11f-f76169ef7f76 req-89d97e47-a5d1-4d9f-96e1-0830c11822d6 service nova] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.network.neutron [req-48432c68-d3b9-46d1-a11f-f76169ef7f76 req-89d97e47-a5d1-4d9f-96e1-0830c11822d6 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing network info cache for port 18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:39:01 user nova-compute[70374]: INFO nova.virt.block_device [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Booting with volume 44581260-7d1e-4f1b-b449-181a52fc3e45 at /dev/vdc
Jul 27 09:39:01 user nova-compute[70374]: DEBUG os_brick.utils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e2a43a-334a-4103-9170-43c615932fde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23934613261373037', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934613261373037', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid ab9c2cd8-7137-4921-b014-5a516da0e249 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e54358-7481-4ab7-8b3b-942dc3f99688]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[91be5cbd-a1b9-4fe2-a1f5-166f41e50b7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d560b3-07c8-4587-a606-70db32c81205]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:39:01 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f144267-3cf4-47d7-850e-1035085d1fc3]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG os_brick.utils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating existing volume attachment record: c0403454-8850-48e2-a285-7a9055fc0bd4 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:39:01 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:39:01 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:39:01 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:39:01 user nova-compute[70374]:   <serial>e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c</serial>
Jul 27 09:39:01 user nova-compute[70374]: </disk>
Jul 27 09:39:01 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:01 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Took 1.44 seconds to deallocate network for instance.
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-31812e77-cea8-42fd-886e-cf489c92d791 req-8c58ae38-7c25-4efc-b9af-99c5294e74ed service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received event network-vif-deleted-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:01 user nova-compute[70374]: INFO nova.compute.manager [req-31812e77-cea8-42fd-886e-cf489c92d791 req-8c58ae38-7c25-4efc-b9af-99c5294e74ed service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Neutron deleted interface 6858719a-7fa4-4a64-ad8a-02c9274adb55; detaching it from the instance and deleting it from the info cache
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.network.neutron [req-31812e77-cea8-42fd-886e-cf489c92d791 req-8c58ae38-7c25-4efc-b9af-99c5294e74ed service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-7a4484e6-af76-45b2-bd7d-905d1d74e025 req-4a9ea865-1640-422e-a883-a7f427895a74 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received event network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a4484e6-af76-45b2-bd7d-905d1d74e025 req-4a9ea865-1640-422e-a883-a7f427895a74 service nova] Acquiring lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a4484e6-af76-45b2-bd7d-905d1d74e025 req-4a9ea865-1640-422e-a883-a7f427895a74 service nova] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7a4484e6-af76-45b2-bd7d-905d1d74e025 req-4a9ea865-1640-422e-a883-a7f427895a74 service nova] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-7a4484e6-af76-45b2-bd7d-905d1d74e025 req-4a9ea865-1640-422e-a883-a7f427895a74 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] No waiting events found dispatching network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:01 user nova-compute[70374]: WARNING nova.compute.manager [req-7a4484e6-af76-45b2-bd7d-905d1d74e025 req-4a9ea865-1640-422e-a883-a7f427895a74 service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Received unexpected event network-vif-plugged-6858719a-7fa4-4a64-ad8a-02c9274adb55 for instance with vm_state active and task_state deleting.
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-31812e77-cea8-42fd-886e-cf489c92d791 req-8c58ae38-7c25-4efc-b9af-99c5294e74ed service nova] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Detach interface failed, port_id=6858719a-7fa4-4a64-ad8a-02c9274adb55, reason: Instance 04a990b9-ed32-41e9-b384-f0886e8d1b49 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.network.neutron [req-48432c68-d3b9-46d1-a11f-f76169ef7f76 req-89d97e47-a5d1-4d9f-96e1-0830c11822d6 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updated VIF entry in instance network info cache for port 18cc95e6-69da-48ba-a8f0-069677e917ad. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG nova.network.neutron [req-48432c68-d3b9-46d1-a11f-f76169ef7f76 req-89d97e47-a5d1-4d9f-96e1-0830c11822d6 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [{"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48432c68-d3b9-46d1-a11f-f76169ef7f76 req-89d97e47-a5d1-4d9f-96e1-0830c11822d6 service nova] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No VIF found with MAC fa:16:3e:a6:5a:17, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Successfully updated port: c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquired lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d6b8f9e5-5700-4ea1-a0be-ec5b42e8bbbe tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.354s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.659s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:39:02 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Deleted allocations for instance 04a990b9-ed32-41e9-b384-f0886e8d1b49
Jul 27 09:39:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0a899371-7d63-4803-bf12-92efb56b7c24 tempest-ServersNegativeTestJSON-1865798359 tempest-ServersNegativeTestJSON-1865798359-project-member] Lock "04a990b9-ed32-41e9-b384-f0886e8d1b49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.379s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Updating instance_info_cache with network_info: [{"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Releasing lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Instance network_info: |[{"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Start _get_guest_xml network_info=[{"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:39:02 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:39:02 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-305128003',display_name='tempest-VolumesSnapshotTestJSON-instance-305128003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-305128003',id=27,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhQH7addfP25IS1QNc4r1AsJMN7674fbEC5suVcgz4lfyY0/KBJ9bTky5LV1V21zwwwOn6IGaJMIcqxx4QCgrdWbDoOHz/sLhw15ZlFiZlfAtK9Xq9vLoKG7kd0+8JXdg==',key_name='tempest-keypair-167604713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d47c627f4a94472a80b922a262aa172',ramdisk_id='',reservation_id='r-1h0g5urz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1299698694',owner_user_name='tempest-VolumesSnapshotTestJSON-1299698694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8d942c3b93453bafa8381f39ec85a9',uuid=f6f417a6-c890-4372-8471-099eae592990,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converting VIF {"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=c30631f7-4236-40e8-8c15-15a6a1d94eaa,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc30631f7-42') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'pci_devices' on Instance uuid f6f417a6-c890-4372-8471-099eae592990 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:39:02 user nova-compute[70374]:   <uuid>f6f417a6-c890-4372-8471-099eae592990</uuid>
Jul 27 09:39:02 user nova-compute[70374]:   <name>instance-0000001b</name>
Jul 27 09:39:02 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:39:02 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:39:02 user nova-compute[70374]:   <metadata>
Jul 27 09:39:02 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:39:02 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:39:02 user nova-compute[70374]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-305128003</nova:name>
Jul 27 09:39:02 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:39:02</nova:creationTime>
Jul 27 09:39:02 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:39:02 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:39:02 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:39:02 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:39:02 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:39:02 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:39:02 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:39:02 user nova-compute[70374]:       <nova:owner>
Jul 27 09:39:02 user nova-compute[70374]:         <nova:user uuid="ce8d942c3b93453bafa8381f39ec85a9">tempest-VolumesSnapshotTestJSON-1299698694-project-member</nova:user>
Jul 27 09:39:02 user nova-compute[70374]:         <nova:project uuid="5d47c627f4a94472a80b922a262aa172">tempest-VolumesSnapshotTestJSON-1299698694</nova:project>
Jul 27 09:39:02 user nova-compute[70374]:       </nova:owner>
Jul 27 09:39:02 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:39:02 user nova-compute[70374]:       <nova:ports>
Jul 27 09:39:02 user nova-compute[70374]:         <nova:port uuid="c30631f7-4236-40e8-8c15-15a6a1d94eaa">
Jul 27 09:39:02 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 09:39:02 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:02 user nova-compute[70374]:       </nova:ports>
Jul 27 09:39:02 user nova-compute[70374]:     </nova:instance>
Jul 27 09:39:02 user nova-compute[70374]:   </metadata>
Jul 27 09:39:02 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:39:02 user nova-compute[70374]:     <system>
Jul 27 09:39:02 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:39:02 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:39:02 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:39:02 user nova-compute[70374]:       <entry name="serial">f6f417a6-c890-4372-8471-099eae592990</entry>
Jul 27 09:39:02 user nova-compute[70374]:       <entry name="uuid">f6f417a6-c890-4372-8471-099eae592990</entry>
Jul 27 09:39:02 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:39:02 user nova-compute[70374]:     </system>
Jul 27 09:39:02 user nova-compute[70374]:   </sysinfo>
Jul 27 09:39:02 user nova-compute[70374]:   <os>
Jul 27 09:39:02 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:39:02 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:39:02 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:39:02 user nova-compute[70374]:   </os>
Jul 27 09:39:02 user nova-compute[70374]:   <features>
Jul 27 09:39:02 user nova-compute[70374]:     <acpi/>
Jul 27 09:39:02 user nova-compute[70374]:     <apic/>
Jul 27 09:39:02 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:39:02 user nova-compute[70374]:   </features>
Jul 27 09:39:02 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:39:02 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:39:02 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:39:02 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:39:02 user nova-compute[70374]:   </clock>
Jul 27 09:39:02 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:39:02 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:39:02 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:39:02 user nova-compute[70374]:   </cpu>
Jul 27 09:39:02 user nova-compute[70374]:   <devices>
Jul 27 09:39:02 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:39:02 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:39:02 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk"/>
Jul 27 09:39:02 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:39:02 user nova-compute[70374]:     </disk>
Jul 27 09:39:02 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:02 user nova-compute[70374]:       <mac address="fa:16:3e:b4:8b:03"/>
Jul 27 09:39:02 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:02 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:02 user nova-compute[70374]:       <target dev="tapc30631f7-42"/>
Jul 27 09:39:02 user nova-compute[70374]:     </interface>
Jul 27 09:39:02 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:39:02 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/console.log" append="off"/>
Jul 27 09:39:02 user nova-compute[70374]:     </serial>
Jul 27 09:39:02 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:39:02 user nova-compute[70374]:     <video>
Jul 27 09:39:02 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:02 user nova-compute[70374]:     </video>
Jul 27 09:39:02 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:39:02 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:39:02 user nova-compute[70374]:     </rng>
Jul 27 09:39:02 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:39:02 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:39:02 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:39:02 user nova-compute[70374]:     </memballoon>
Jul 27 09:39:02 user nova-compute[70374]:   </devices>
Jul 27 09:39:02 user nova-compute[70374]: </domain>
Jul 27 09:39:02 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-305128003',display_name='tempest-VolumesSnapshotTestJSON-instance-305128003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-305128003',id=27,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhQH7addfP25IS1QNc4r1AsJMN7674fbEC5suVcgz4lfyY0/KBJ9bTky5LV1V21zwwwOn6IGaJMIcqxx4QCgrdWbDoOHz/sLhw15ZlFiZlfAtK9Xq9vLoKG7kd0+8JXdg==',key_name='tempest-keypair-167604713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d47c627f4a94472a80b922a262aa172',ramdisk_id='',reservation_id='r-1h0g5urz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1299698694',owner_user_name='tempest-VolumesSnapshotTestJSON-1299698694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8d942c3b93453bafa8381f39ec85a9',uuid=f6f417a6-c890-4372-8471-099eae592990,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converting VIF {"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=c30631f7-4236-40e8-8c15-15a6a1d94eaa,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc30631f7-42') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG os_vif [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=c30631f7-4236-40e8-8c15-15a6a1d94eaa,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc30631f7-42') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc30631f7-42, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc30631f7-42, col_values=(('external_ids', {'iface-id': 'c30631f7-4236-40e8-8c15-15a6a1d94eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:8b:03', 'vm-uuid': 'f6f417a6-c890-4372-8471-099eae592990'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:03 user nova-compute[70374]: INFO os_vif [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=c30631f7-4236-40e8-8c15-15a6a1d94eaa,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc30631f7-42')
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No VIF found with MAC fa:16:3e:b4:8b:03, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-f9d82274-66de-49ff-83b2-0ec1ef090a99 req-7ac65d27-be6d-4e99-aa49-2545cd976ae6 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received event network-changed-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-f9d82274-66de-49ff-83b2-0ec1ef090a99 req-7ac65d27-be6d-4e99-aa49-2545cd976ae6 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Refreshing instance network info cache due to event network-changed-c30631f7-4236-40e8-8c15-15a6a1d94eaa. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f9d82274-66de-49ff-83b2-0ec1ef090a99 req-7ac65d27-be6d-4e99-aa49-2545cd976ae6 service nova] Acquiring lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f9d82274-66de-49ff-83b2-0ec1ef090a99 req-7ac65d27-be6d-4e99-aa49-2545cd976ae6 service nova] Acquired lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.network.neutron [req-f9d82274-66de-49ff-83b2-0ec1ef090a99 req-7ac65d27-be6d-4e99-aa49-2545cd976ae6 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Refreshing network info cache for port c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:39:03 user nova-compute[70374]: INFO nova.compute.manager [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Detaching volume e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c
Jul 27 09:39:03 user nova-compute[70374]: INFO nova.virt.block_device [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Attempting to driver detach volume e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c from mountpoint /dev/vdb
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Attempting to detach device vdb from instance ab9c2cd8-7137-4921-b014-5a516da0e249 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:39:03 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:39:03 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:39:03 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:39:03 user nova-compute[70374]:   <serial>e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c</serial>
Jul 27 09:39:03 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:39:03 user nova-compute[70374]: </disk>
Jul 27 09:39:03 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:39:03 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully detached device vdb from instance ab9c2cd8-7137-4921-b014-5a516da0e249 from the persistent domain config.
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab9c2cd8-7137-4921-b014-5a516da0e249 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:39:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:39:03 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:39:03 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:39:03 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:39:03 user nova-compute[70374]:   <serial>e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c</serial>
Jul 27 09:39:03 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:39:03 user nova-compute[70374]: </disk>
Jul 27 09:39:03 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG nova.network.neutron [req-f9d82274-66de-49ff-83b2-0ec1ef090a99 req-7ac65d27-be6d-4e99-aa49-2545cd976ae6 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Updated VIF entry in instance network info cache for port c30631f7-4236-40e8-8c15-15a6a1d94eaa. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG nova.network.neutron [req-f9d82274-66de-49ff-83b2-0ec1ef090a99 req-7ac65d27-be6d-4e99-aa49-2545cd976ae6 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Updating instance_info_cache with network_info: [{"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f9d82274-66de-49ff-83b2-0ec1ef090a99 req-7ac65d27-be6d-4e99-aa49-2545cd976ae6 service nova] Releasing lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450744.855406, ab9c2cd8-7137-4921-b014-5a516da0e249 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab9c2cd8-7137-4921-b014-5a516da0e249 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:39:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully detached device vdb from instance ab9c2cd8-7137-4921-b014-5a516da0e249 from the live domain config.
Jul 27 09:39:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqVXhoGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:04 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2d120-cea2-4f1d-8dfd-4b31dad24650]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:39:04 user nova-compute[70374]: No targets found.
Jul 27 09:39:04 user nova-compute[70374]: iSNS:
Jul 27 09:39:04 user nova-compute[70374]: No targets found.
Jul 27 09:39:04 user nova-compute[70374]: STATIC:
Jul 27 09:39:04 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c
Jul 27 09:39:04 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:39:04 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:39:04 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b
Jul 27 09:39:04 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:39:04 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:39:04 user nova-compute[70374]: FIRMWARE:
Jul 27 09:39:04 user nova-compute[70374]: No targets found.
Jul 27 09:39:04 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:39:04 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:39:04 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dcf8d7-a6f5-4867-be57-a4be6f35c53f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-b5ad1b6d-b05a-4327-bb5c-500ced87fd71 req-e101c4af-4b88-4b30-8ed3-33604178dc4a service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received event network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b5ad1b6d-b05a-4327-bb5c-500ced87fd71 req-e101c4af-4b88-4b30-8ed3-33604178dc4a service nova] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b5ad1b6d-b05a-4327-bb5c-500ced87fd71 req-e101c4af-4b88-4b30-8ed3-33604178dc4a service nova] Lock "f6f417a6-c890-4372-8471-099eae592990-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b5ad1b6d-b05a-4327-bb5c-500ced87fd71 req-e101c4af-4b88-4b30-8ed3-33604178dc4a service nova] Lock "f6f417a6-c890-4372-8471-099eae592990-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-b5ad1b6d-b05a-4327-bb5c-500ced87fd71 req-e101c4af-4b88-4b30-8ed3-33604178dc4a service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] No waiting events found dispatching network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:04 user nova-compute[70374]: WARNING nova.compute.manager [req-b5ad1b6d-b05a-4327-bb5c-500ced87fd71 req-e101c4af-4b88-4b30-8ed3-33604178dc4a service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received unexpected event network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa for instance with vm_state building and task_state spawning.
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4404a8b3-c7cd-4228-aef7-1f4367a591cd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:04 user nova-compute[70374]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c (non-flash)
Jul 27 09:39:04 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:04 user nova-compute[70374]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c (non-flash)
Jul 27 09:39:04 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc120160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:39:04 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[39780690-cfb8-45a7-b80f-519d09cb9271]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f1ef49-af53-40a3-abc2-4462a9423442]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.030s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[701768eb-521d-4350-8025-e9a58f558591]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c99450-1cb1-404e-ade3-d2b3558c36dc]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[57459081-b6d7-49b5-b634-4ec897762459]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e688ab-826c-47df-b81d-df88f5230b7f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c, portal: 172.16.0.220,3260]
Jul 27 09:39:05 user nova-compute[70374]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c, portal: 172.16.0.220,3260] successful.
Jul 27 09:39:05 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2676ff9-7c2f-46e5-8e6b-cad8ce5c738c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b3dab-99ca-4fb8-ad4d-4e133b0aacfa]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== disconnect_volume: return (374ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:06 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid ab9c2cd8-7137-4921-b014-5a516da0e249 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9de205b3-f483-4818-8ef3-703271e6cde8 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.418s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-9ced7426-1cdb-43b1-a404-83750662a9bc req-95269e08-a318-46a8-abf7-68b59a3bec62 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received event network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9ced7426-1cdb-43b1-a404-83750662a9bc req-95269e08-a318-46a8-abf7-68b59a3bec62 service nova] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9ced7426-1cdb-43b1-a404-83750662a9bc req-95269e08-a318-46a8-abf7-68b59a3bec62 service nova] Lock "f6f417a6-c890-4372-8471-099eae592990-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9ced7426-1cdb-43b1-a404-83750662a9bc req-95269e08-a318-46a8-abf7-68b59a3bec62 service nova] Lock "f6f417a6-c890-4372-8471-099eae592990-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-9ced7426-1cdb-43b1-a404-83750662a9bc req-95269e08-a318-46a8-abf7-68b59a3bec62 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] No waiting events found dispatching network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:07 user nova-compute[70374]: WARNING nova.compute.manager [req-9ced7426-1cdb-43b1-a404-83750662a9bc req-95269e08-a318-46a8-abf7-68b59a3bec62 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received unexpected event network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa for instance with vm_state building and task_state spawning.
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450747.201843, f6f417a6-c890-4372-8471-099eae592990 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:07 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] VM Resumed (Lifecycle Event)
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:39:07 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: f6f417a6-c890-4372-8471-099eae592990] Instance spawned successfully.
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:07 user nova-compute[70374]: INFO nova.compute.manager [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Terminating instance
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:07 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450747.2037547, f6f417a6-c890-4372-8471-099eae592990 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:07 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] VM Started (Lifecycle Event)
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:39:07 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:39:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:07 user nova-compute[70374]: INFO nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Took 8.16 seconds to spawn the instance on the hypervisor.
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:07 user nova-compute[70374]: INFO nova.compute.manager [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Took 9.46 seconds to build instance.
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2308887b-fc4d-45a1-8767-fddd70a11a84 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.587s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-5f6566d2-e4b1-49b3-979d-d5d7e5caed2e req-b4302acb-f2c0-4eae-b80f-9812006e3c8c service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-vif-unplugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5f6566d2-e4b1-49b3-979d-d5d7e5caed2e req-b4302acb-f2c0-4eae-b80f-9812006e3c8c service nova] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5f6566d2-e4b1-49b3-979d-d5d7e5caed2e req-b4302acb-f2c0-4eae-b80f-9812006e3c8c service nova] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5f6566d2-e4b1-49b3-979d-d5d7e5caed2e req-b4302acb-f2c0-4eae-b80f-9812006e3c8c service nova] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-5f6566d2-e4b1-49b3-979d-d5d7e5caed2e req-b4302acb-f2c0-4eae-b80f-9812006e3c8c service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] No waiting events found dispatching network-vif-unplugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-5f6566d2-e4b1-49b3-979d-d5d7e5caed2e req-b4302acb-f2c0-4eae-b80f-9812006e3c8c service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-vif-unplugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:39:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:08 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Instance destroyed successfully.
Jul 27 09:39:08 user nova-compute[70374]: DEBUG nova.objects.instance [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lazy-loading 'resources' on Instance uuid ea21f129-1e0a-4ad1-b516-c2a8f92835b7 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-161038782',display_name='tempest-TestStampPattern-server-161038782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-161038782',id=12,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj2SFnPDau6vQCtjDQG1ZxRhv34b+wb9sn5YbvH/SZ654hrAREIUSioV28ip+GznAtPzx4FbU600mwPtKiSdblyqS0Oc7MrVQ7evq+7Ird+40EGlZ1xk19BS7xqljznJA==',key_name='tempest-TestStampPattern-355396374',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:31:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b6c645430b147a0983e499772a43790',ramdisk_id='',reservation_id='r-siobf74j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-795018650',owner_user_name='tempest-TestStampPattern-795018650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:35:04Z,user_data=None,user_id='fa672f231aae45d6a68bddddf583dcde',uuid=ea21f129-1e0a-4ad1-b516-c2a8f92835b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converting VIF {"id": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "address": "fa:16:3e:37:d2:3d", "network": {"id": "cb56461a-b7fd-4c8f-94b2-20029820dfd1", "bridge": "br-int", "label": "tempest-TestStampPattern-1598636493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6c645430b147a0983e499772a43790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaecacb1-2e", "ovs_interfaceid": "faecacb1-2e14-4d38-8c90-bfb3ff5e23a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:d2:3d,bridge_name='br-int',has_traffic_filtering=True,id=faecacb1-2e14-4d38-8c90-bfb3ff5e23a7,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaecacb1-2e') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG os_vif [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:d2:3d,bridge_name='br-int',has_traffic_filtering=True,id=faecacb1-2e14-4d38-8c90-bfb3ff5e23a7,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaecacb1-2e') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfaecacb1-2e, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:08 user nova-compute[70374]: INFO os_vif [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:d2:3d,bridge_name='br-int',has_traffic_filtering=True,id=faecacb1-2e14-4d38-8c90-bfb3ff5e23a7,network=Network(cb56461a-b7fd-4c8f-94b2-20029820dfd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaecacb1-2e')
Jul 27 09:39:08 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Deleting instance files /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7_del
Jul 27 09:39:08 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Deletion of /opt/stack/data/nova/instances/ea21f129-1e0a-4ad1-b516-c2a8f92835b7_del complete
Jul 27 09:39:08 user nova-compute[70374]: INFO nova.compute.manager [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 09:39:08 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:08 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Took 0.62 seconds to deallocate network for instance.
Jul 27 09:39:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-0b11346a-0758-4a6e-a399-e4f807ad3ca3 req-9ba3c52b-3b9b-41ea-a3f7-91f88d8f6028 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-changed-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-0b11346a-0758-4a6e-a399-e4f807ad3ca3 req-9ba3c52b-3b9b-41ea-a3f7-91f88d8f6028 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Refreshing instance network info cache due to event network-changed-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0b11346a-0758-4a6e-a399-e4f807ad3ca3 req-9ba3c52b-3b9b-41ea-a3f7-91f88d8f6028 service nova] Acquiring lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0b11346a-0758-4a6e-a399-e4f807ad3ca3 req-9ba3c52b-3b9b-41ea-a3f7-91f88d8f6028 service nova] Acquired lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.network.neutron [req-0b11346a-0758-4a6e-a399-e4f807ad3ca3 req-9ba3c52b-3b9b-41ea-a3f7-91f88d8f6028 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Refreshing network info cache for port faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.network.neutron [req-0b11346a-0758-4a6e-a399-e4f807ad3ca3 req-9ba3c52b-3b9b-41ea-a3f7-91f88d8f6028 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:09 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Deleted allocations for instance ea21f129-1e0a-4ad1-b516-c2a8f92835b7
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.network.neutron [req-0b11346a-0758-4a6e-a399-e4f807ad3ca3 req-9ba3c52b-3b9b-41ea-a3f7-91f88d8f6028 service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-af465413-5976-4fec-933f-4a01031b21a8 tempest-TestStampPattern-795018650 tempest-TestStampPattern-795018650-project-member] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0b11346a-0758-4a6e-a399-e4f807ad3ca3 req-9ba3c52b-3b9b-41ea-a3f7-91f88d8f6028 service nova] Releasing lock "refresh_cache-ea21f129-1e0a-4ad1-b516-c2a8f92835b7" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-ec45a005-8f24-4844-8ca7-8c6e87a21b8b req-efb85a00-292e-4010-b96f-8e484520281c service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ec45a005-8f24-4844-8ca7-8c6e87a21b8b req-efb85a00-292e-4010-b96f-8e484520281c service nova] Acquiring lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ec45a005-8f24-4844-8ca7-8c6e87a21b8b req-efb85a00-292e-4010-b96f-8e484520281c service nova] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ec45a005-8f24-4844-8ca7-8c6e87a21b8b req-efb85a00-292e-4010-b96f-8e484520281c service nova] Lock "ea21f129-1e0a-4ad1-b516-c2a8f92835b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-ec45a005-8f24-4844-8ca7-8c6e87a21b8b req-efb85a00-292e-4010-b96f-8e484520281c service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] No waiting events found dispatching network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:09 user nova-compute[70374]: WARNING nova.compute.manager [req-ec45a005-8f24-4844-8ca7-8c6e87a21b8b req-efb85a00-292e-4010-b96f-8e484520281c service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received unexpected event network-vif-plugged-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 for instance with vm_state deleted and task_state None.
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-ec45a005-8f24-4844-8ca7-8c6e87a21b8b req-efb85a00-292e-4010-b96f-8e484520281c service nova] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Received event network-vif-deleted-faecacb1-2e14-4d38-8c90-bfb3ff5e23a7 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:39:09 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Creating image(s)
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Ensure instance console log exists: /opt/stack/data/nova/instances/27316e38-df5e-433e-bd67-719ea7caeab4/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Start _get_guest_xml network_info=[{"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'fc8c0b06-f856-4137-b0b7-1115fe950c9f', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYFxqcJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27316e38-df5e-433e-bd67-719ea7caeab4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c858282f-5798-4275-98d4-8b5a5a8e7ac5', 'serial': 'c858282f-5798-4275-98d4-8b5a5a8e7ac5'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'device_type': 'disk', 'attachment_id': '5dd9900e-67e6-47d3-98af-8484093a195e', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APSnbTQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27316e38-df5e-433e-bd67-719ea7caeab4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c42b0d80-658e-4dbd-b383-80edaea79aed', 'serial': 'c42b0d80-658e-4dbd-b383-80edaea79aed'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'device_type': 'disk', 'attachment_id': 'c0403454-8850-48e2-a285-7a9055fc0bd4', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYlSthQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27316e38-df5e-433e-bd67-719ea7caeab4', 'attached_at': '', 'detached_at': '', 'volume_id': '44581260-7d1e-4f1b-b449-181a52fc3e45', 'serial': '44581260-7d1e-4f1b-b449-181a52fc3e45'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:09 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:39:09 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYFxqcJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:09 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:09 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:09 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[396fef0e-cef3-486c-a272-30ad861fd5a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:39:09 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b7ee7-b261-4ddd-ac14-9689d01f7333]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5] added
Jul 27 09:39:09 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a522ba-4f06-4cd6-8b57-1bb83c33cf75]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f039ddf-f013-48ac-8fd0-61b7ff2c96ed]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYFxqcJB {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYFxqcJB" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c375852e-0ec7-4374-afee-b49033a5d6a9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uYFxqcJB'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae37179-19e0-4255-b596-6824231e09a5]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ce9ba-6874-4746-bf5f-dc2662901546]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:10 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:10 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c177837-6b20-4e45-b7af-1c82e4c97a54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5, portal: 172.16.0.220,3260]
Jul 27 09:39:10 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5, portal: 172.16.0.220,3260] successful.
Jul 27 09:39:10 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d941276a-da11-4566-ad13-1eef95777902]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2935aad4-d662-4bc8-a74a-29aa41e61567]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:10 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:10 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:10 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:10 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[931878bc-9843-4c20-9d6c-7b54441791dd]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYFxqcJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23539653864363435', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539653864363435', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APSnbTQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:11 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:11 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:11 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365d8e2-fbb7-4ce7-b3a3-211d3ab6b525]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:39:11 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e67016-92de-4d75-ba71-cfae74d4567b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed] added
Jul 27 09:39:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d74951c-aa22-46bd-af30-0edfdfdaa916]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be3b51c-d925-45d9-bd91-7437d02a5a62]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APSnbTQC {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APSnbTQC" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e39a83-4757-4117-84d5-af930184fc8d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APSnbTQC'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cdb671-aee7-42d2-abf1-76aa0d8d0252]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f2d4e4-ec93-46cf-a3eb-b296fa85459c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:11 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:11 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8f342c-2931-48c0-bfd5-ba0951d0c7c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed, portal: 172.16.0.220,3260]
Jul 27 09:39:11 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed, portal: 172.16.0.220,3260] successful.
Jul 27 09:39:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9224419-ff98-4056-8ddb-8623c358e38d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[af637aec-a11a-4c9c-a3cd-7d01b8bd3f75]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:11 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:11 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:11 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:11 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[19239f40-2f0f-4d09-811e-390a0fb7caff]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:39:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APSnbTQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26362646136303230', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362646136303230', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYlSthQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:12 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:12 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:12 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad73e9fe-99b6-4dd4-8410-6ac620cd7e34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:39:12 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3be95a0-2d99-4079-95a6-f9dbefa71b3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45] added
Jul 27 09:39:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2673e109-7b9e-4039-8a2e-c91601c5f51c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62ccb8-1240-4afc-b2d5-d3ec5df1e979]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYlSthQr {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYlSthQr" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4e433c-0e29-4eb3-b8fd-f35c038b407b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYlSthQr'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f97d9f-a931-465c-aeff-c4ac91aa1df0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35d19ba-8e63-42e7-8947-3565e7758c9c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2c71ed-e133-433c-902b-d14cd031136a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45, portal: 172.16.0.220,3260]
Jul 27 09:39:12 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45, portal: 172.16.0.220,3260] successful.
Jul 27 09:39:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf6094d-074d-4706-b263-74ee594061ce]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d527838c-8248-45d4-a44a-02a22ea15b36]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:12 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e4b16b-6e64-4def-8de0-2b561f4d5a14]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYlSthQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23038313362326534', 'path': '/dev/sde'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038313362326534', 'path': '/dev/sde'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b,network=Network(a3e3545b-d3df-49cc-8c8a-a08a99bb69d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ccd9110-0b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:76:8d,bridge_name='br-int',has_traffic_filtering=True,id=e82a7a06-2db3-48f1-883e-2253df574d5e,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape82a7a06-2d') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9f:e0,bridge_name='br-int',has_traffic_filtering=True,id=fd818b43-d661-467a-b885-7a67f78bc578,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd818b43-d6') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:30,bridge_name='br-int',has_traffic_filtering=True,id=296190d8-e4e1-4d98-9c48-b588d5fa4157,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296190d8-e4') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4b7b0f-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7a:27,bridge_name='br-int',has_traffic_filtering=True,id=b019f062-cc3b-4d3f-bb48-553ff5ccc6ce,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb019f062-cc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:2f:ca,bridge_name='br-int',has_traffic_filtering=True,id=18cc95e6-69da-48ba-a8f0-069677e917ad,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18cc95e6-69') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.objects.instance [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lazy-loading 'pci_devices' on Instance uuid 27316e38-df5e-433e-bd67-719ea7caeab4 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:39:14 user nova-compute[70374]:   <uuid>27316e38-df5e-433e-bd67-719ea7caeab4</uuid>
Jul 27 09:39:14 user nova-compute[70374]:   <name>instance-00000019</name>
Jul 27 09:39:14 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:39:14 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:39:14 user nova-compute[70374]:   <metadata>
Jul 27 09:39:14 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:39:14 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:39:14 user nova-compute[70374]:       <nova:name>tempest-device-tagging-server-1106722277</nova:name>
Jul 27 09:39:14 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:39:09</nova:creationTime>
Jul 27 09:39:14 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:39:14 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:39:14 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:39:14 user nova-compute[70374]:       <nova:owner>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:user uuid="0edfda9256e04349bf903c0d13168ca2">tempest-TaggedBootDevicesTest_v242-645937837-project-member</nova:user>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:project uuid="e64a77073d6849c2a31d4acd7eb389eb">tempest-TaggedBootDevicesTest_v242-645937837</nova:project>
Jul 27 09:39:14 user nova-compute[70374]:       </nova:owner>
Jul 27 09:39:14 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:39:14 user nova-compute[70374]:       <nova:ports>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:port uuid="6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b">
Jul 27 09:39:14 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 09:39:14 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:port uuid="e82a7a06-2db3-48f1-883e-2253df574d5e">
Jul 27 09:39:14 user nova-compute[70374]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Jul 27 09:39:14 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:port uuid="fd818b43-d661-467a-b885-7a67f78bc578">
Jul 27 09:39:14 user nova-compute[70374]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Jul 27 09:39:14 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:port uuid="296190d8-e4e1-4d98-9c48-b588d5fa4157">
Jul 27 09:39:14 user nova-compute[70374]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Jul 27 09:39:14 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:port uuid="ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9">
Jul 27 09:39:14 user nova-compute[70374]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Jul 27 09:39:14 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:port uuid="b019f062-cc3b-4d3f-bb48-553ff5ccc6ce">
Jul 27 09:39:14 user nova-compute[70374]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 09:39:14 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:14 user nova-compute[70374]:         <nova:port uuid="18cc95e6-69da-48ba-a8f0-069677e917ad">
Jul 27 09:39:14 user nova-compute[70374]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 09:39:14 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:14 user nova-compute[70374]:       </nova:ports>
Jul 27 09:39:14 user nova-compute[70374]:     </nova:instance>
Jul 27 09:39:14 user nova-compute[70374]:   </metadata>
Jul 27 09:39:14 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:39:14 user nova-compute[70374]:     <system>
Jul 27 09:39:14 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:39:14 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:39:14 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:39:14 user nova-compute[70374]:       <entry name="serial">27316e38-df5e-433e-bd67-719ea7caeab4</entry>
Jul 27 09:39:14 user nova-compute[70374]:       <entry name="uuid">27316e38-df5e-433e-bd67-719ea7caeab4</entry>
Jul 27 09:39:14 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:39:14 user nova-compute[70374]:     </system>
Jul 27 09:39:14 user nova-compute[70374]:   </sysinfo>
Jul 27 09:39:14 user nova-compute[70374]:   <os>
Jul 27 09:39:14 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:39:14 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:39:14 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:39:14 user nova-compute[70374]:   </os>
Jul 27 09:39:14 user nova-compute[70374]:   <features>
Jul 27 09:39:14 user nova-compute[70374]:     <acpi/>
Jul 27 09:39:14 user nova-compute[70374]:     <apic/>
Jul 27 09:39:14 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:39:14 user nova-compute[70374]:   </features>
Jul 27 09:39:14 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:39:14 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:39:14 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:39:14 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:39:14 user nova-compute[70374]:   </clock>
Jul 27 09:39:14 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:39:14 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:39:14 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:39:14 user nova-compute[70374]:   </cpu>
Jul 27 09:39:14 user nova-compute[70374]:   <devices>
Jul 27 09:39:14 user nova-compute[70374]:     <disk type="file" device="cdrom">
Jul 27 09:39:14 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 09:39:14 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/27316e38-df5e-433e-bd67-719ea7caeab4/disk.config"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="hda" bus="ide"/>
Jul 27 09:39:14 user nova-compute[70374]:     </disk>
Jul 27 09:39:14 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:39:14 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:39:14 user nova-compute[70374]:       <source dev="/dev/sdc"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <serial>c858282f-5798-4275-98d4-8b5a5a8e7ac5</serial>
Jul 27 09:39:14 user nova-compute[70374]:     </disk>
Jul 27 09:39:14 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:39:14 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:39:14 user nova-compute[70374]:       <source dev="/dev/sdd"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <serial>c42b0d80-658e-4dbd-b383-80edaea79aed</serial>
Jul 27 09:39:14 user nova-compute[70374]:     </disk>
Jul 27 09:39:14 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:39:14 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:39:14 user nova-compute[70374]:       <source dev="/dev/sde"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="vdc" bus="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <serial>44581260-7d1e-4f1b-b449-181a52fc3e45</serial>
Jul 27 09:39:14 user nova-compute[70374]:     </disk>
Jul 27 09:39:14 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:14 user nova-compute[70374]:       <mac address="fa:16:3e:c1:9b:88"/>
Jul 27 09:39:14 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="tap6ccd9110-0b"/>
Jul 27 09:39:14 user nova-compute[70374]:     </interface>
Jul 27 09:39:14 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:14 user nova-compute[70374]:       <mac address="fa:16:3e:8e:76:8d"/>
Jul 27 09:39:14 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="tape82a7a06-2d"/>
Jul 27 09:39:14 user nova-compute[70374]:     </interface>
Jul 27 09:39:14 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:14 user nova-compute[70374]:       <mac address="fa:16:3e:42:9f:e0"/>
Jul 27 09:39:14 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="tapfd818b43-d6"/>
Jul 27 09:39:14 user nova-compute[70374]:     </interface>
Jul 27 09:39:14 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:14 user nova-compute[70374]:       <mac address="fa:16:3e:6e:34:30"/>
Jul 27 09:39:14 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="tap296190d8-e4"/>
Jul 27 09:39:14 user nova-compute[70374]:     </interface>
Jul 27 09:39:14 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:14 user nova-compute[70374]:       <mac address="fa:16:3e:ec:fc:03"/>
Jul 27 09:39:14 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="tapad4b7b0f-0c"/>
Jul 27 09:39:14 user nova-compute[70374]:     </interface>
Jul 27 09:39:14 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:14 user nova-compute[70374]:       <mac address="fa:16:3e:cf:7a:27"/>
Jul 27 09:39:14 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="tapb019f062-cc"/>
Jul 27 09:39:14 user nova-compute[70374]:     </interface>
Jul 27 09:39:14 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:14 user nova-compute[70374]:       <mac address="fa:16:3e:e5:2f:ca"/>
Jul 27 09:39:14 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:14 user nova-compute[70374]:       <target dev="tap18cc95e6-69"/>
Jul 27 09:39:14 user nova-compute[70374]:     </interface>
Jul 27 09:39:14 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:39:14 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/27316e38-df5e-433e-bd67-719ea7caeab4/console.log" append="off"/>
Jul 27 09:39:14 user nova-compute[70374]:     </serial>
Jul 27 09:39:14 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:39:14 user nova-compute[70374]:     <video>
Jul 27 09:39:14 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:14 user nova-compute[70374]:     </video>
Jul 27 09:39:14 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:39:14 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:39:14 user nova-compute[70374]:     </rng>
Jul 27 09:39:14 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:39:14 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:39:14 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:39:14 user nova-compute[70374]:     </memballoon>
Jul 27 09:39:14 user nova-compute[70374]:   </devices>
Jul 27 09:39:14 user nova-compute[70374]: </domain>
Jul 27 09:39:14 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b,network=Network(a3e3545b-d3df-49cc-8c8a-a08a99bb69d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ccd9110-0b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b,network=Network(a3e3545b-d3df-49cc-8c8a-a08a99bb69d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ccd9110-0b') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ccd9110-0b, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ccd9110-0b, col_values=(('external_ids', {'iface-id': '6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:9b:88', 'vm-uuid': '27316e38-df5e-433e-bd67-719ea7caeab4'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: INFO os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b,network=Network(a3e3545b-d3df-49cc-8c8a-a08a99bb69d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ccd9110-0b')
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:76:8d,bridge_name='br-int',has_traffic_filtering=True,id=e82a7a06-2db3-48f1-883e-2253df574d5e,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape82a7a06-2d') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:76:8d,bridge_name='br-int',has_traffic_filtering=True,id=e82a7a06-2db3-48f1-883e-2253df574d5e,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape82a7a06-2d') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape82a7a06-2d, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape82a7a06-2d, col_values=(('external_ids', {'iface-id': 'e82a7a06-2db3-48f1-883e-2253df574d5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:76:8d', 'vm-uuid': '27316e38-df5e-433e-bd67-719ea7caeab4'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: INFO os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:76:8d,bridge_name='br-int',has_traffic_filtering=True,id=e82a7a06-2db3-48f1-883e-2253df574d5e,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape82a7a06-2d')
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9f:e0,bridge_name='br-int',has_traffic_filtering=True,id=fd818b43-d661-467a-b885-7a67f78bc578,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd818b43-d6') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9f:e0,bridge_name='br-int',has_traffic_filtering=True,id=fd818b43-d661-467a-b885-7a67f78bc578,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd818b43-d6') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd818b43-d6, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd818b43-d6, col_values=(('external_ids', {'iface-id': 'fd818b43-d661-467a-b885-7a67f78bc578', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:9f:e0', 'vm-uuid': '27316e38-df5e-433e-bd67-719ea7caeab4'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: INFO os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9f:e0,bridge_name='br-int',has_traffic_filtering=True,id=fd818b43-d661-467a-b885-7a67f78bc578,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd818b43-d6')
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:30,bridge_name='br-int',has_traffic_filtering=True,id=296190d8-e4e1-4d98-9c48-b588d5fa4157,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296190d8-e4') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:30,bridge_name='br-int',has_traffic_filtering=True,id=296190d8-e4e1-4d98-9c48-b588d5fa4157,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296190d8-e4') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap296190d8-e4, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap296190d8-e4, col_values=(('external_ids', {'iface-id': '296190d8-e4e1-4d98-9c48-b588d5fa4157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:34:30', 'vm-uuid': '27316e38-df5e-433e-bd67-719ea7caeab4'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: INFO os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:30,bridge_name='br-int',has_traffic_filtering=True,id=296190d8-e4e1-4d98-9c48-b588d5fa4157,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296190d8-e4')
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4b7b0f-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4b7b0f-0c') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad4b7b0f-0c, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad4b7b0f-0c, col_values=(('external_ids', {'iface-id': 'ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:fc:03', 'vm-uuid': '27316e38-df5e-433e-bd67-719ea7caeab4'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: INFO os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4b7b0f-0c')
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7a:27,bridge_name='br-int',has_traffic_filtering=True,id=b019f062-cc3b-4d3f-bb48-553ff5ccc6ce,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb019f062-cc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7a:27,bridge_name='br-int',has_traffic_filtering=True,id=b019f062-cc3b-4d3f-bb48-553ff5ccc6ce,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb019f062-cc') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb019f062-cc, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb019f062-cc, col_values=(('external_ids', {'iface-id': 'b019f062-cc3b-4d3f-bb48-553ff5ccc6ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:7a:27', 'vm-uuid': '27316e38-df5e-433e-bd67-719ea7caeab4'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: INFO os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7a:27,bridge_name='br-int',has_traffic_filtering=True,id=b019f062-cc3b-4d3f-bb48-553ff5ccc6ce,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb019f062-cc')
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:2f:ca,bridge_name='br-int',has_traffic_filtering=True,id=18cc95e6-69da-48ba-a8f0-069677e917ad,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18cc95e6-69') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:2f:ca,bridge_name='br-int',has_traffic_filtering=True,id=18cc95e6-69da-48ba-a8f0-069677e917ad,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18cc95e6-69') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18cc95e6-69, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18cc95e6-69, col_values=(('external_ids', {'iface-id': '18cc95e6-69da-48ba-a8f0-069677e917ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:2f:ca', 'vm-uuid': '27316e38-df5e-433e-bd67-719ea7caeab4'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: INFO os_vif [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:2f:ca,bridge_name='br-int',has_traffic_filtering=True,id=18cc95e6-69da-48ba-a8f0-069677e917ad,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18cc95e6-69')
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] No BDM found with device name hda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] No VIF found with MAC fa:16:3e:c1:9b:88, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] No VIF found with MAC fa:16:3e:ec:fc:03, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:39:14 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Using config drive
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:14 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Creating config drive at /opt/stack/data/nova/instances/27316e38-df5e-433e-bd67-719ea7caeab4/disk.config
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27316e38-df5e-433e-bd67-719ea7caeab4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3vkif35_ {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27316e38-df5e-433e-bd67-719ea7caeab4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3vkif35_" returned: 0 in 0.084s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450740.1919885, 04a990b9-ed32-41e9-b384-f0886e8d1b49 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:15 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] VM Stopped (Lifecycle Event)
Jul 27 09:39:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1ccecd2b-ed99-49e2-9089-cf6cb2970928 None None] [instance: 04a990b9-ed32-41e9-b384-f0886e8d1b49] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:16 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:39:16 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7012MB free_disk=25.482086181640625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25214e8a-c626-46a7-b273-eb491c2fc91b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 30aa3eca-5c9f-443a-af70-461010d4e22e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance aba5a5a4-266b-4511-86ee-258843bd41a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 69a59942-cd83-4f74-82ea-f23a6538cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ab9c2cd8-7137-4921-b014-5a516da0e249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 3070aa19-a0a5-40a1-a697-727da1c1cf61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 27316e38-df5e-433e-bd67-719ea7caeab4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 66911d11-4025-4243-9f8e-ff0909460190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance f6f417a6-c890-4372-8471-099eae592990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.manager [req-d4ac0a38-94b7-4dcf-bd21-1b4e5c37e8e3 req-26475093-aa10-41da-8b74-23d3c7f1f7eb service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d4ac0a38-94b7-4dcf-bd21-1b4e5c37e8e3 req-26475093-aa10-41da-8b74-23d3c7f1f7eb service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d4ac0a38-94b7-4dcf-bd21-1b4e5c37e8e3 req-26475093-aa10-41da-8b74-23d3c7f1f7eb service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d4ac0a38-94b7-4dcf-bd21-1b4e5c37e8e3 req-26475093-aa10-41da-8b74-23d3c7f1f7eb service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.manager [req-d4ac0a38-94b7-4dcf-bd21-1b4e5c37e8e3 req-26475093-aa10-41da-8b74-23d3c7f1f7eb service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:16 user nova-compute[70374]: WARNING nova.compute.manager [req-d4ac0a38-94b7-4dcf-bd21-1b4e5c37e8e3 req-26475093-aa10-41da-8b74-23d3c7f1f7eb service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b for instance with vm_state building and task_state spawning.
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.manager [req-745ff5f8-855a-4114-9fac-1cb0b3ceb19b req-188c0f9d-21ee-40ee-83ef-dee9ebb723ce service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-745ff5f8-855a-4114-9fac-1cb0b3ceb19b req-188c0f9d-21ee-40ee-83ef-dee9ebb723ce service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-745ff5f8-855a-4114-9fac-1cb0b3ceb19b req-188c0f9d-21ee-40ee-83ef-dee9ebb723ce service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-745ff5f8-855a-4114-9fac-1cb0b3ceb19b req-188c0f9d-21ee-40ee-83ef-dee9ebb723ce service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:16 user nova-compute[70374]: DEBUG nova.compute.manager [req-745ff5f8-855a-4114-9fac-1cb0b3ceb19b req-188c0f9d-21ee-40ee-83ef-dee9ebb723ce service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:16 user nova-compute[70374]: WARNING nova.compute.manager [req-745ff5f8-855a-4114-9fac-1cb0b3ceb19b req-188c0f9d-21ee-40ee-83ef-dee9ebb723ce service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e for instance with vm_state building and task_state spawning.
Jul 27 09:39:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-79ead982-06a0-46dc-8eb2-fab6031e070e req-b04289fa-5c7d-4b19-bb80-27196b54a490 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-79ead982-06a0-46dc-8eb2-fab6031e070e req-b04289fa-5c7d-4b19-bb80-27196b54a490 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-79ead982-06a0-46dc-8eb2-fab6031e070e req-b04289fa-5c7d-4b19-bb80-27196b54a490 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-79ead982-06a0-46dc-8eb2-fab6031e070e req-b04289fa-5c7d-4b19-bb80-27196b54a490 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-79ead982-06a0-46dc-8eb2-fab6031e070e req-b04289fa-5c7d-4b19-bb80-27196b54a490 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:17 user nova-compute[70374]: WARNING nova.compute.manager [req-79ead982-06a0-46dc-8eb2-fab6031e070e req-b04289fa-5c7d-4b19-bb80-27196b54a490 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 for instance with vm_state building and task_state spawning.
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:18 user nova-compute[70374]: INFO nova.compute.manager [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Terminating instance
Jul 27 09:39:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:18 user nova-compute[70374]: WARNING nova.compute.manager [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b for instance with vm_state building and task_state spawning.
Jul 27 09:39:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:18 user nova-compute[70374]: WARNING nova.compute.manager [req-63d2ea15-bc29-42ef-bea7-63dd13d79395 req-4fa89377-e525-44d6-94e4-6580f66b79c9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce for instance with vm_state building and task_state spawning.
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:19 user nova-compute[70374]: WARNING nova.compute.manager [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e for instance with vm_state building and task_state spawning.
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-unplugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] No waiting events found dispatching network-vif-unplugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-27667055-4e37-4a80-9eaf-1cd2a2ff7a4f req-24bb2ebc-e3b2-4ecb-a039-fd9de5f8e936 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-unplugged-6b853298-921d-44cf-951d-d55fe9364ac3 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Instance destroyed successfully.
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.objects.instance [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'resources' on Instance uuid aba5a5a4-266b-4511-86ee-258843bd41a5 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:19 user nova-compute[70374]: WARNING nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 for instance with vm_state building and task_state spawning.
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:19 user nova-compute[70374]: WARNING nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 for instance with vm_state building and task_state spawning.
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:19 user nova-compute[70374]: WARNING nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 for instance with vm_state building and task_state spawning.
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:19 user nova-compute[70374]: WARNING nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 for instance with vm_state building and task_state spawning.
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:19 user nova-compute[70374]: WARNING nova.compute.manager [req-5e8605ae-4b59-4550-a818-3e60e4492b05 req-68367d1d-a059-4907-9d2e-8efe1119b60f service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 for instance with vm_state building and task_state spawning.
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1139130470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1596074640',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8G6KrvwXmmOIoccubLX+h6m1EvIBOsR9+vrs/DIs+D3vVzZbUf4UgeHVwvBZKMtROvY8D1A5S38Px3VM0d025CGUjOdGb+pLp/X7j79D5ZGu1WOGNArT636xnxQb1rRw==',key_name='tempest-keypair-828280280',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:37:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-00d5td73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=aba5a5a4-266b-4511-86ee-258843bd41a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "6b853298-921d-44cf-951d-d55fe9364ac3", "address": "fa:16:3e:16:85:da", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b853298-92", "ovs_interfaceid": "6b853298-921d-44cf-951d-d55fe9364ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_vif [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b853298-92, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: INFO os_vif [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:85:da,bridge_name='br-int',has_traffic_filtering=True,id=6b853298-921d-44cf-951d-d55fe9364ac3,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b853298-92')
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcAVmPHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:19 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae5b117-1285-404a-af38-3d034037cc87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:39:19 user nova-compute[70374]: No targets found.
Jul 27 09:39:19 user nova-compute[70374]: iSNS:
Jul 27 09:39:19 user nova-compute[70374]: No targets found.
Jul 27 09:39:19 user nova-compute[70374]: STATIC:
Jul 27 09:39:19 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5
Jul 27 09:39:19 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:39:19 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:39:19 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed
Jul 27 09:39:19 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:39:19 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:39:19 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b
Jul 27 09:39:19 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:39:19 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:39:19 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45
Jul 27 09:39:19 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:39:19 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:39:19 user nova-compute[70374]: FIRMWARE:
Jul 27 09:39:19 user nova-compute[70374]: No targets found.
Jul 27 09:39:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:39:19 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:39:19 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd619c9-d047-423e-a880-2667411d2967]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dadabc5-6060-4dbc-ac38-28be38843f66]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:19 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:19 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:19 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b (non-flash)
Jul 27 09:39:19 user nova-compute[70374]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:19 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:19 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280b9ae7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc69607-58b6-453d-9e69-0ce084bf91ae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8083c9-ec83-4636-b75e-a414cd354c30]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac6333b-943e-4648-a6da-8593e19aac2c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7942aa-e8a0-443c-a5bf-1c2dfa63822c]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a94f428-7b70-474e-a711-25020973e125]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa632e6-50d6-4b7f-82d4-52ecfd567821]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260]
Jul 27 09:39:19 user nova-compute[70374]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b, portal: 172.16.0.220,3260] successful.
Jul 27 09:39:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a4bd30-7c85-4645-88ac-cb52c4883a2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8918d24-87a4-4647-9a22-2a6289540224]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] <== disconnect_volume: return (365ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:39:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Deleting instance files /opt/stack/data/nova/instances/aba5a5a4-266b-4511-86ee-258843bd41a5_del
Jul 27 09:39:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Deletion of /opt/stack/data/nova/instances/aba5a5a4-266b-4511-86ee-258843bd41a5_del complete
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:39:19 user nova-compute[70374]: INFO nova.compute.manager [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Took 1.37 seconds to destroy the instance on the hypervisor.
Jul 27 09:39:19 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:39:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:20 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Took 0.81 seconds to deallocate network for instance.
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:20 user nova-compute[70374]: WARNING nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce for instance with vm_state building and task_state spawning.
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:20 user nova-compute[70374]: WARNING nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad for instance with vm_state building and task_state spawning.
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:20 user nova-compute[70374]: WARNING nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad for instance with vm_state building and task_state spawning.
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f0b0b1a8-26f2-47d1-a2a9-25a2c0320fab req-84cd852b-d252-4ba0-b89a-34743d1e8737 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-deleted-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450760.8190277, 27316e38-df5e-433e-bd67-719ea7caeab4 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:20 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] VM Resumed (Lifecycle Event)
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:39:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance spawned successfully.
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:39:20 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450760.8207085, 27316e38-df5e-433e-bd67-719ea7caeab4 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:20 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] VM Started (Lifecycle Event)
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:39:20 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:39:20 user nova-compute[70374]: INFO nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Took 11.17 seconds to spawn the instance on the hypervisor.
Jul 27 09:39:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:21 user nova-compute[70374]: INFO nova.compute.manager [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Took 38.79 seconds to build instance.
Jul 27 09:39:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-665391ac-1c30-4bba-a452-e3b380d24121 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "27316e38-df5e-433e-bd67-719ea7caeab4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.908s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-b35dc5ed-dfc4-4a09-b576-5a471880452f req-8e37c85d-e989-49e1-b7af-54cc23799a17 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b35dc5ed-dfc4-4a09-b576-5a471880452f req-8e37c85d-e989-49e1-b7af-54cc23799a17 service nova] Acquiring lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b35dc5ed-dfc4-4a09-b576-5a471880452f req-8e37c85d-e989-49e1-b7af-54cc23799a17 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b35dc5ed-dfc4-4a09-b576-5a471880452f req-8e37c85d-e989-49e1-b7af-54cc23799a17 service nova] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-b35dc5ed-dfc4-4a09-b576-5a471880452f req-8e37c85d-e989-49e1-b7af-54cc23799a17 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] No waiting events found dispatching network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:21 user nova-compute[70374]: WARNING nova.compute.manager [req-b35dc5ed-dfc4-4a09-b576-5a471880452f req-8e37c85d-e989-49e1-b7af-54cc23799a17 service nova] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Received unexpected event network-vif-plugged-6b853298-921d-44cf-951d-d55fe9364ac3 for instance with vm_state active and task_state deleting.
Jul 27 09:39:21 user nova-compute[70374]: INFO nova.compute.manager [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Took 0.71 seconds to detach 1 volumes for instance.
Jul 27 09:39:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Deleting volume: 25a4bd30-7c85-4645-88ac-cb52c4883a2b {{(pid=70374) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:39:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:21 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Deleted allocations for instance aba5a5a4-266b-4511-86ee-258843bd41a5
Jul 27 09:39:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-95ce8969-adb8-450f-9aba-338b4ebb8cd9 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "aba5a5a4-266b-4511-86ee-258843bd41a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.533s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:23 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450748.047525, ea21f129-1e0a-4ad1-b516-c2a8f92835b7 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:23 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] VM Stopped (Lifecycle Event)
Jul 27 09:39:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-40b0999c-96ed-41eb-b06c-dc3caf3a972e None None] [instance: ea21f129-1e0a-4ad1-b516-c2a8f92835b7] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'flavor' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:29 user nova-compute[70374]: INFO nova.compute.manager [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Attaching volume 4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 to /dev/vdb
Jul 27 09:39:29 user nova-compute[70374]: DEBUG os_brick.utils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9394a7e-b527-434d-bb34-606c5db65a8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1bd473-4f73-49e0-8b4a-9a9ad1782ce6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[81584657-f076-4976-9b9d-a4e50e6d14e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a443fb-09df-46ab-a475-796c03e145c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:39:29 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:39:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3812135f-bf30-4e28-a523-457e8a569599]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG os_brick.utils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating existing volume attachment record: 60ba8cd4-9c97-4b58-b021-030a973e9cae {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:39:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:34 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450759.224587, aba5a5a4-266b-4511-86ee-258843bd41a5 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:34 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] VM Stopped (Lifecycle Event)
Jul 27 09:39:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1f1db59e-6f1b-4f67-8148-345a566fd7dd None None] [instance: aba5a5a4-266b-4511-86ee-258843bd41a5] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyEgrLbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:36 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:36 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:36 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2176652-0d7b-4527-8c9b-05d5f75d5958]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:39:36 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e5e784-6cbf-481d-9976-0cd28c80c7b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3] added
Jul 27 09:39:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[488866c2-bb96-469f-9e2f-84333c4b35f5]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4213aeec-4afd-4e8e-b794-b94bcea31efb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyEgrLbM {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyEgrLbM" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a795723-4683-4df1-9ae2-c7a887b3b4ed]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GyEgrLbM'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6081bf-449b-4889-aad6-dee99fac17a1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[44906fb4-ebe5-4361-952a-55bce15fd12c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[342bef96-6b27-4004-beb8-5920a981069a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3, portal: 172.16.0.220,3260]
Jul 27 09:39:36 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3, portal: 172.16.0.220,3260] successful.
Jul 27 09:39:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80b552-4696-4b08-a3aa-7c670bbab69c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9dd9a-52ca-4bc4-aa3b-67192c41d610]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:39:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:39:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[30229e3d-6c66-4a7e-8f2e-1372657c8277]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:37 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:39:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyEgrLbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23235366164313562', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235366164313562', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'flavor' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:39:38 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:39:38 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:39:38 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:39:38 user nova-compute[70374]:   <serial>4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3</serial>
Jul 27 09:39:38 user nova-compute[70374]: </disk>
Jul 27 09:39:38 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-7653f561-5fdc-4398-9cf0-c1cc7486cdc2 req-c86eabbb-6fd9-40de-834b-eddd979f153e service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-changed-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-7653f561-5fdc-4398-9cf0-c1cc7486cdc2 req-c86eabbb-6fd9-40de-834b-eddd979f153e service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Refreshing instance network info cache due to event network-changed-5e54f01f-0732-4e78-bcc1-f9e45af08a0a. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7653f561-5fdc-4398-9cf0-c1cc7486cdc2 req-c86eabbb-6fd9-40de-834b-eddd979f153e service nova] Acquiring lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7653f561-5fdc-4398-9cf0-c1cc7486cdc2 req-c86eabbb-6fd9-40de-834b-eddd979f153e service nova] Acquired lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-7653f561-5fdc-4398-9cf0-c1cc7486cdc2 req-c86eabbb-6fd9-40de-834b-eddd979f153e service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Refreshing network info cache for port 5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No VIF found with MAC fa:16:3e:19:61:ec, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-7653f561-5fdc-4398-9cf0-c1cc7486cdc2 req-c86eabbb-6fd9-40de-834b-eddd979f153e service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updated VIF entry in instance network info cache for port 5e54f01f-0732-4e78-bcc1-f9e45af08a0a. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-7653f561-5fdc-4398-9cf0-c1cc7486cdc2 req-c86eabbb-6fd9-40de-834b-eddd979f153e service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7653f561-5fdc-4398-9cf0-c1cc7486cdc2 req-c86eabbb-6fd9-40de-834b-eddd979f153e service nova] Releasing lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:39:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6c7b2093-9a87-48a0-bccc-b6f4bbf2237b tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.251s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:39 user nova-compute[70374]: INFO nova.compute.manager [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Rescuing
Jul 27 09:39:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:39:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquired lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:39:39 user nova-compute[70374]: DEBUG nova.network.neutron [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:39:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:39 user nova-compute[70374]: DEBUG nova.network.neutron [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Releasing lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e8d54a33-2821-416f-8ba4-7e5cd37da2df req-13e62c2b-9292-4162-8c4c-5b9d5921fda7 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8d54a33-2821-416f-8ba4-7e5cd37da2df req-13e62c2b-9292-4162-8c4c-5b9d5921fda7 service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8d54a33-2821-416f-8ba4-7e5cd37da2df req-13e62c2b-9292-4162-8c4c-5b9d5921fda7 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8d54a33-2821-416f-8ba4-7e5cd37da2df req-13e62c2b-9292-4162-8c4c-5b9d5921fda7 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e8d54a33-2821-416f-8ba4-7e5cd37da2df req-13e62c2b-9292-4162-8c4c-5b9d5921fda7 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:40 user nova-compute[70374]: WARNING nova.compute.manager [req-e8d54a33-2821-416f-8ba4-7e5cd37da2df req-13e62c2b-9292-4162-8c4c-5b9d5921fda7 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state active and task_state rescuing.
Jul 27 09:39:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:40 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance destroyed successfully.
Jul 27 09:39:40 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Attempting a stable device rescue
Jul 27 09:39:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70374) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance directory exists: not creating {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 09:39:40 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Creating image(s)
Jul 27 09:39:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24.part --force-share --output=json" returned: 0 in 0.130s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG nova.virt.images [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] 24adc4ee-46da-43b2-a12f-971ccedd169d was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24.part /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-ff15513d-c742-47ff-a2bf-c227554ce803 req-928462e2-a45f-433e-813a-69b34394c29b service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ff15513d-c742-47ff-a2bf-c227554ce803 req-928462e2-a45f-433e-813a-69b34394c29b service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ff15513d-c742-47ff-a2bf-c227554ce803 req-928462e2-a45f-433e-813a-69b34394c29b service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ff15513d-c742-47ff-a2bf-c227554ce803 req-928462e2-a45f-433e-813a-69b34394c29b service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-ff15513d-c742-47ff-a2bf-c227554ce803 req-928462e2-a45f-433e-813a-69b34394c29b service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:42 user nova-compute[70374]: WARNING nova.compute.manager [req-ff15513d-c742-47ff-a2bf-c227554ce803 req-928462e2-a45f-433e-813a-69b34394c29b service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state active and task_state rescuing.
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24.part /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24.converted" returned: 0 in 0.576s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.896s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24 --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24,backing_fmt=raw /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24,backing_fmt=raw /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue" returned: 0 in 0.048s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:42 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'migration_context' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Start _get_guest_xml network_info=[{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "vif_mac": "fa:16:3e:19:61:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '24adc4ee-46da-43b2-a12f-971ccedd169d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '60ba8cd4-9c97-4b58-b021-030a973e9cae', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyEgrLbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '69a59942-cd83-4f74-82ea-f23a6538cef9', 'attached_at': '', 'detached_at': '', 'volume_id': '4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3', 'serial': '4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'resources' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'numa_topology' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:43 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:39:43 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyEgrLbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:39:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:39:43 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ffe12-d984-482b-8d45-4998b080b369]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GyEgrLbM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 09:39:43 user nova-compute[70374]: node.name = iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:39:43 user nova-compute[70374]: node.tpgt = -1
Jul 27 09:39:43 user nova-compute[70374]: node.startup = automatic
Jul 27 09:39:43 user nova-compute[70374]: node.leading_login = No
Jul 27 09:39:43 user nova-compute[70374]: iface.iscsi_ifacename = default
Jul 27 09:39:43 user nova-compute[70374]: iface.net_ifacename = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.ipaddress = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.prefix_len = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.hwaddress = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.transport_name = tcp
Jul 27 09:39:43 user nova-compute[70374]: iface.initiatorname = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.state = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.vlan_id = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.vlan_priority = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.vlan_state = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.iface_num = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.mtu = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.port = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.bootproto = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.subnet_mask = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.gateway = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.dhcp_alt_client_id = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.dhcp_dns = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.dhcp_learn_iqn = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.dhcp_vendor_id_state = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.dhcp_vendor_id = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.dhcp_slp_da = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.fragmentation = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.gratuitous_arp = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.incoming_forwarding = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.tos_state = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.tos = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.ttl = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.delayed_ack = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.tcp_nagle = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.tcp_wsf_state = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.tcp_wsf = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.tcp_timer_scale = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.tcp_timestamp = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.redirect = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.def_task_mgmt_timeout = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.header_digest = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.data_digest = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.immediate_data = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.initial_r2t = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.data_seq_inorder = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.data_pdu_inorder = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.erl = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.max_receive_data_len = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.first_burst_len = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.max_outstanding_r2t = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.max_burst_len = 0
Jul 27 09:39:43 user nova-compute[70374]: iface.chap_auth = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.bidi_chap = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.strict_login_compliance = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.discovery_auth = <empty>
Jul 27 09:39:43 user nova-compute[70374]: iface.discovery_logout = <empty>
Jul 27 09:39:43 user nova-compute[70374]: node.discovery_address = <empty>
Jul 27 09:39:43 user nova-compute[70374]: node.discovery_port = 0
Jul 27 09:39:43 user nova-compute[70374]: node.discovery_type = static
Jul 27 09:39:43 user nova-compute[70374]: node.session.initial_cmdsn = 0
Jul 27 09:39:43 user nova-compute[70374]: node.session.initial_login_retry_max = 8
Jul 27 09:39:43 user nova-compute[70374]: node.session.xmit_thread_priority = -20
Jul 27 09:39:43 user nova-compute[70374]: node.session.cmds_max = 128
Jul 27 09:39:43 user nova-compute[70374]: node.session.queue_depth = 32
Jul 27 09:39:43 user nova-compute[70374]: node.session.nr_sessions = 1
Jul 27 09:39:43 user nova-compute[70374]: node.session.auth.authmethod = CHAP
Jul 27 09:39:43 user nova-compute[70374]: node.session.auth.username = GyEgrLbM
Jul 27 09:39:43 user nova-compute[70374]: node.session.auth.password = ***
Jul 27 09:39:43 user nova-compute[70374]: node.session.auth.username_in = <empty>
Jul 27 09:39:43 user nova-compute[70374]: node.session.auth.password_in = <empty>
Jul 27 09:39:43 user nova-compute[70374]: node.session.auth.chap_algs = MD5
Jul 27 09:39:43 user nova-compute[70374]: node.session.timeo.replacement_timeout = 120
Jul 27 09:39:43 user nova-compute[70374]: node.session.err_timeo.abort_timeout = 15
Jul 27 09:39:43 user nova-compute[70374]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 09:39:43 user nova-compute[70374]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 09:39:43 user nova-compute[70374]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.FastAbort = Yes
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.InitialR2T = No
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.ImmediateData = Yes
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.MaxConnections = 1
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 09:39:43 user nova-compute[70374]: node.session.iscsi.ERL = 0
Jul 27 09:39:43 user nova-compute[70374]: node.session.scan = manual
Jul 27 09:39:43 user nova-compute[70374]: node.session.reopen_max = 0
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].address = 172.16.0.220
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].port = 3260
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].startup = manual
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].tcp.window_size = 524288
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].tcp.type_of_service = 0
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].timeo.logout_timeout = 15
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].timeo.login_timeout = 15
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].timeo.auth_timeout = 45
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].iscsi.DataDigest = None
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].iscsi.IFMarker = No
Jul 27 09:39:43 user nova-compute[70374]: node.conn[0].iscsi.OFMarker = No
Jul 27 09:39:43 user nova-compute[70374]: # END RECORD
Jul 27 09:39:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f131af1-fb92-4af8-a0f2-e5549e6dc0c1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ef265-b657-458c-b017-57bc2c9c2148]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyEgrLbM {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyEgrLbM" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5bd0e1-5db2-4aef-9438-4dd841409238]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GyEgrLbM'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16f2dd9-8ed4-4e25-8a27-19ced9060050]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e5a76-7d4c-4bd5-b2a3-5eef3826e164]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:43 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:43 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:43 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:39:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:39:43 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:39:43 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:39:43 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:39:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] HCTL ('33', '0', '0', 0) found on session 24 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed429b7e-a257-4632-bb17-4acfbbd1aacc]: (4, ('0 0 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Searching for a device in session 24 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyEgrLbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23235366164313562', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235366164313562', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-5155036',display_name='tempest-ServerStableDeviceRescueTest-server-5155036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-5155036',id=20,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6R6pxyWguYUpGbhXDryFF98r4EErMCAduikmtB8A7jMw32ji5zDskUehPZkgpAo/t9hS38SlQ9OuQGv2/gK7wmIRQk7DqCx9aHpB4MCMzUppNMZq/hdilw2TBZ+Ny5lg==',key_name='tempest-keypair-589835980',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb71f9530b5d43f28bde4f13f2200408',ramdisk_id='',reservation_id='r-4qrsflrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1292987631',owner_user_name='tempest-ServerStableDeviceRescueTest-1292987631-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f9403033f534073a59cb12f3d02bc91',uuid=69a59942-cd83-4f74-82ea-f23a6538cef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "vif_mac": "fa:16:3e:19:61:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Converting VIF {"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "vif_mac": "fa:16:3e:19:61:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:61:ec,bridge_name='br-int',has_traffic_filtering=True,id=08a126de-9aff-4def-baa5-0401181a8d3b,network=Network(5f60f46f-086a-4008-a28e-a5aee728a59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a126de-9a') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'pci_devices' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:39:43 user nova-compute[70374]:   <uuid>69a59942-cd83-4f74-82ea-f23a6538cef9</uuid>
Jul 27 09:39:43 user nova-compute[70374]:   <name>instance-00000014</name>
Jul 27 09:39:43 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:39:43 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:39:43 user nova-compute[70374]:   <metadata>
Jul 27 09:39:43 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:39:43 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:39:43 user nova-compute[70374]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-5155036</nova:name>
Jul 27 09:39:43 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:39:43</nova:creationTime>
Jul 27 09:39:43 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:39:43 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:39:43 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:39:43 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:39:43 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:39:43 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:39:43 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:39:43 user nova-compute[70374]:       <nova:owner>
Jul 27 09:39:43 user nova-compute[70374]:         <nova:user uuid="1f9403033f534073a59cb12f3d02bc91">tempest-ServerStableDeviceRescueTest-1292987631-project-member</nova:user>
Jul 27 09:39:43 user nova-compute[70374]:         <nova:project uuid="cb71f9530b5d43f28bde4f13f2200408">tempest-ServerStableDeviceRescueTest-1292987631</nova:project>
Jul 27 09:39:43 user nova-compute[70374]:       </nova:owner>
Jul 27 09:39:43 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:39:43 user nova-compute[70374]:       <nova:ports>
Jul 27 09:39:43 user nova-compute[70374]:         <nova:port uuid="08a126de-9aff-4def-baa5-0401181a8d3b">
Jul 27 09:39:43 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 09:39:43 user nova-compute[70374]:         </nova:port>
Jul 27 09:39:43 user nova-compute[70374]:       </nova:ports>
Jul 27 09:39:43 user nova-compute[70374]:     </nova:instance>
Jul 27 09:39:43 user nova-compute[70374]:   </metadata>
Jul 27 09:39:43 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:39:43 user nova-compute[70374]:     <system>
Jul 27 09:39:43 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:39:43 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:39:43 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:39:43 user nova-compute[70374]:       <entry name="serial">69a59942-cd83-4f74-82ea-f23a6538cef9</entry>
Jul 27 09:39:43 user nova-compute[70374]:       <entry name="uuid">69a59942-cd83-4f74-82ea-f23a6538cef9</entry>
Jul 27 09:39:43 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:39:43 user nova-compute[70374]:     </system>
Jul 27 09:39:43 user nova-compute[70374]:   </sysinfo>
Jul 27 09:39:43 user nova-compute[70374]:   <os>
Jul 27 09:39:43 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:39:43 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:39:43 user nova-compute[70374]:   </os>
Jul 27 09:39:43 user nova-compute[70374]:   <features>
Jul 27 09:39:43 user nova-compute[70374]:     <acpi/>
Jul 27 09:39:43 user nova-compute[70374]:     <apic/>
Jul 27 09:39:43 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:39:43 user nova-compute[70374]:   </features>
Jul 27 09:39:43 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:39:43 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:39:43 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:39:43 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:39:43 user nova-compute[70374]:   </clock>
Jul 27 09:39:43 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:39:43 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:39:43 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:39:43 user nova-compute[70374]:   </cpu>
Jul 27 09:39:43 user nova-compute[70374]:   <devices>
Jul 27 09:39:43 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:39:43 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:39:43 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk"/>
Jul 27 09:39:43 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:39:43 user nova-compute[70374]:     </disk>
Jul 27 09:39:43 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:39:43 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:39:43 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 09:39:43 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:39:43 user nova-compute[70374]:       <serial>4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3</serial>
Jul 27 09:39:43 user nova-compute[70374]:     </disk>
Jul 27 09:39:43 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:39:43 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:39:43 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue"/>
Jul 27 09:39:43 user nova-compute[70374]:       <target dev="vdc" bus="virtio"/>
Jul 27 09:39:43 user nova-compute[70374]:       <boot order="1"/>
Jul 27 09:39:43 user nova-compute[70374]:     </disk>
Jul 27 09:39:43 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:39:43 user nova-compute[70374]:       <mac address="fa:16:3e:19:61:ec"/>
Jul 27 09:39:43 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:43 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:39:43 user nova-compute[70374]:       <target dev="tap08a126de-9a"/>
Jul 27 09:39:43 user nova-compute[70374]:     </interface>
Jul 27 09:39:43 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:39:43 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/console.log" append="off"/>
Jul 27 09:39:43 user nova-compute[70374]:     </serial>
Jul 27 09:39:43 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:39:43 user nova-compute[70374]:     <video>
Jul 27 09:39:43 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:39:43 user nova-compute[70374]:     </video>
Jul 27 09:39:43 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:39:43 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:39:43 user nova-compute[70374]:     </rng>
Jul 27 09:39:43 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:39:43 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:39:43 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:39:43 user nova-compute[70374]:     </memballoon>
Jul 27 09:39:43 user nova-compute[70374]:   </devices>
Jul 27 09:39:43 user nova-compute[70374]: </domain>
Jul 27 09:39:43 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:39:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance destroyed successfully.
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:39:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] No VIF found with MAC fa:16:3e:19:61:ec, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-586a6813-2802-498d-968f-abcdb973ddd8 req-1b31551f-c16b-4d97-bdea-bab31e84d5c5 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-586a6813-2802-498d-968f-abcdb973ddd8 req-1b31551f-c16b-4d97-bdea-bab31e84d5c5 service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-586a6813-2802-498d-968f-abcdb973ddd8 req-1b31551f-c16b-4d97-bdea-bab31e84d5c5 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-586a6813-2802-498d-968f-abcdb973ddd8 req-1b31551f-c16b-4d97-bdea-bab31e84d5c5 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-586a6813-2802-498d-968f-abcdb973ddd8 req-1b31551f-c16b-4d97-bdea-bab31e84d5c5 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:44 user nova-compute[70374]: WARNING nova.compute.manager [req-586a6813-2802-498d-968f-abcdb973ddd8 req-1b31551f-c16b-4d97-bdea-bab31e84d5c5 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state active and task_state rescuing.
Jul 27 09:39:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 69a59942-cd83-4f74-82ea-f23a6538cef9 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:39:46 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450786.8755093, 69a59942-cd83-4f74-82ea-f23a6538cef9 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:46 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] VM Resumed (Lifecycle Event)
Jul 27 09:39:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9a1d6e66-56e7-4671-98e7-5dc82ca00b2f tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:39:46 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 09:39:46 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450786.8773484, 69a59942-cd83-4f74-82ea-f23a6538cef9 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:39:46 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] VM Started (Lifecycle Event)
Jul 27 09:39:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:39:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:39:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-8f883456-059c-403f-a8fa-21f070bc8a0c req-a62df345-9129-457b-9d69-c4057e84ef49 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8f883456-059c-403f-a8fa-21f070bc8a0c req-a62df345-9129-457b-9d69-c4057e84ef49 service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8f883456-059c-403f-a8fa-21f070bc8a0c req-a62df345-9129-457b-9d69-c4057e84ef49 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8f883456-059c-403f-a8fa-21f070bc8a0c req-a62df345-9129-457b-9d69-c4057e84ef49 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-8f883456-059c-403f-a8fa-21f070bc8a0c req-a62df345-9129-457b-9d69-c4057e84ef49 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:47 user nova-compute[70374]: WARNING nova.compute.manager [req-8f883456-059c-403f-a8fa-21f070bc8a0c req-a62df345-9129-457b-9d69-c4057e84ef49 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state rescued and task_state None.
Jul 27 09:39:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:54 user nova-compute[70374]: INFO nova.compute.manager [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Terminating instance
Jul 27 09:39:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-3249ca89-6e0b-4678-8b02-b4c714f98c57 req-30a696a6-3ce6-4ec6-b813-0d22373742a9 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received event network-vif-unplugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3249ca89-6e0b-4678-8b02-b4c714f98c57 req-30a696a6-3ce6-4ec6-b813-0d22373742a9 service nova] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3249ca89-6e0b-4678-8b02-b4c714f98c57 req-30a696a6-3ce6-4ec6-b813-0d22373742a9 service nova] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3249ca89-6e0b-4678-8b02-b4c714f98c57 req-30a696a6-3ce6-4ec6-b813-0d22373742a9 service nova] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-3249ca89-6e0b-4678-8b02-b4c714f98c57 req-30a696a6-3ce6-4ec6-b813-0d22373742a9 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] No waiting events found dispatching network-vif-unplugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-3249ca89-6e0b-4678-8b02-b4c714f98c57 req-30a696a6-3ce6-4ec6-b813-0d22373742a9 service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received event network-vif-unplugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Instance destroyed successfully.
Jul 27 09:39:55 user nova-compute[70374]: DEBUG nova.objects.instance [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'resources' on Instance uuid ab9c2cd8-7137-4921-b014-5a516da0e249 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-381123875',display_name='tempest-AttachVolumeNegativeTest-server-381123875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-381123875',id=22,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbALol5psGEcNXzAj+xMcdNQCt5qsAk4Q5PN11kp34pOMGupCf0TWLRPqswF8va6h9PvwsGnYUAuq+iKyNwS27gUV2JyA89jLI+KKOKMGfa7c7JDrht6x0ja+eIpdJWJQ==',key_name='tempest-keypair-1992961608',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:37:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-7u09ssg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=ab9c2cd8-7137-4921-b014-5a516da0e249,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "address": "fa:16:3e:a6:5a:17", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407194e8-45", "ovs_interfaceid": "407194e8-45f0-4dc4-89ab-f9ed8a4fdbed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:5a:17,bridge_name='br-int',has_traffic_filtering=True,id=407194e8-45f0-4dc4-89ab-f9ed8a4fdbed,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407194e8-45') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG os_vif [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:5a:17,bridge_name='br-int',has_traffic_filtering=True,id=407194e8-45f0-4dc4-89ab-f9ed8a4fdbed,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407194e8-45') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap407194e8-45, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:55 user nova-compute[70374]: INFO os_vif [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:5a:17,bridge_name='br-int',has_traffic_filtering=True,id=407194e8-45f0-4dc4-89ab-f9ed8a4fdbed,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407194e8-45')
Jul 27 09:39:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Deleting instance files /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249_del
Jul 27 09:39:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Deletion of /opt/stack/data/nova/instances/ab9c2cd8-7137-4921-b014-5a516da0e249_del complete
Jul 27 09:39:55 user nova-compute[70374]: INFO nova.compute.manager [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 27 09:39:55 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:55 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:55 user nova-compute[70374]: INFO nova.compute.manager [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Terminating instance
Jul 27 09:39:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:39:56 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Took 0.94 seconds to deallocate network for instance.
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-0253e2e1-13ca-4519-97f3-3c7276d164e1 req-6760eed8-8ae6-4db9-91fd-5cdf623d5012 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0253e2e1-13ca-4519-97f3-3c7276d164e1 req-6760eed8-8ae6-4db9-91fd-5cdf623d5012 service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0253e2e1-13ca-4519-97f3-3c7276d164e1 req-6760eed8-8ae6-4db9-91fd-5cdf623d5012 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0253e2e1-13ca-4519-97f3-3c7276d164e1 req-6760eed8-8ae6-4db9-91fd-5cdf623d5012 service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-0253e2e1-13ca-4519-97f3-3c7276d164e1 req-6760eed8-8ae6-4db9-91fd-5cdf623d5012 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-0253e2e1-13ca-4519-97f3-3c7276d164e1 req-6760eed8-8ae6-4db9-91fd-5cdf623d5012 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-unplugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-f5c4ebbb-3215-4c64-be2f-77a5aa9f926b req-d6f785b2-d0af-450c-aa2b-4e161a80b90e service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received event network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f5c4ebbb-3215-4c64-be2f-77a5aa9f926b req-d6f785b2-d0af-450c-aa2b-4e161a80b90e service nova] Acquiring lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f5c4ebbb-3215-4c64-be2f-77a5aa9f926b req-d6f785b2-d0af-450c-aa2b-4e161a80b90e service nova] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f5c4ebbb-3215-4c64-be2f-77a5aa9f926b req-d6f785b2-d0af-450c-aa2b-4e161a80b90e service nova] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-f5c4ebbb-3215-4c64-be2f-77a5aa9f926b req-d6f785b2-d0af-450c-aa2b-4e161a80b90e service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] No waiting events found dispatching network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:56 user nova-compute[70374]: WARNING nova.compute.manager [req-f5c4ebbb-3215-4c64-be2f-77a5aa9f926b req-d6f785b2-d0af-450c-aa2b-4e161a80b90e service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received unexpected event network-vif-plugged-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed for instance with vm_state deleted and task_state None.
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-f5c4ebbb-3215-4c64-be2f-77a5aa9f926b req-d6f785b2-d0af-450c-aa2b-4e161a80b90e service nova] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Received event network-vif-deleted-407194e8-45f0-4dc4-89ab-f9ed8a4fdbed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:56 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Deleted allocations for instance ab9c2cd8-7137-4921-b014-5a516da0e249
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12e3571b-a213-4069-9b5d-3e3a931adc19 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "ab9c2cd8-7137-4921-b014-5a516da0e249" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.587s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:56 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Instance destroyed successfully.
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'resources' on Instance uuid 25214e8a-c626-46a7-b273-eb491c2fc91b {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1408375692',display_name='tempest-AttachVolumeTestJSON-server-1408375692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1408375692',id=6,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4a+uuDJdqeVGpMRf7PQlRSay+NAyjm/sX+4sRLANkXhl666R+2mNTJErxc9gBj9CSDiBIOY84BLAEFeJbf+9HEQDaVHrP8hjj5t2eksYyAEX3isjtLYaCVXeF4Zy8Ywg==',key_name='tempest-keypair-1085396211',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-kqq9tpu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:38:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=25214e8a-c626-46a7-b273-eb491c2fc91b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "address": "fa:16:3e:b2:af:a6", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb825d9b4-15", "ovs_interfaceid": "b825d9b4-15c4-4b47-a3f7-af9838d09458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG os_vif [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb825d9b4-15, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:39:56 user nova-compute[70374]: INFO os_vif [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:a6,bridge_name='br-int',has_traffic_filtering=True,id=b825d9b4-15c4-4b47-a3f7-af9838d09458,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb825d9b4-15')
Jul 27 09:39:56 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Deleting instance files /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b_del
Jul 27 09:39:56 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Deletion of /opt/stack/data/nova/instances/25214e8a-c626-46a7-b273-eb491c2fc91b_del complete
Jul 27 09:39:56 user nova-compute[70374]: INFO nova.compute.manager [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 27 09:39:56 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:39:56 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:39:57 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:39:57 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Took 0.90 seconds to deallocate network for instance.
Jul 27 09:39:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:58 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:39:58 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:39:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:58 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Deleted allocations for instance 25214e8a-c626-46a7-b273-eb491c2fc91b
Jul 27 09:39:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e607bed5-835c-4e1a-92f7-3dde5d5bfbfc tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.382s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-d85441a9-a897-412b-bbae-de9100e14db0 req-f0f36d35-dba1-4619-8acf-11e90123cace service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d85441a9-a897-412b-bbae-de9100e14db0 req-f0f36d35-dba1-4619-8acf-11e90123cace service nova] Acquiring lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:39:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d85441a9-a897-412b-bbae-de9100e14db0 req-f0f36d35-dba1-4619-8acf-11e90123cace service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:39:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d85441a9-a897-412b-bbae-de9100e14db0 req-f0f36d35-dba1-4619-8acf-11e90123cace service nova] Lock "25214e8a-c626-46a7-b273-eb491c2fc91b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:39:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-d85441a9-a897-412b-bbae-de9100e14db0 req-f0f36d35-dba1-4619-8acf-11e90123cace service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] No waiting events found dispatching network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:39:58 user nova-compute[70374]: WARNING nova.compute.manager [req-d85441a9-a897-412b-bbae-de9100e14db0 req-f0f36d35-dba1-4619-8acf-11e90123cace service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received unexpected event network-vif-plugged-b825d9b4-15c4-4b47-a3f7-af9838d09458 for instance with vm_state deleted and task_state None.
Jul 27 09:39:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-2a4b30d2-2b5d-4029-b1a5-80c3c06ca2d6 req-eaf439cd-ef9f-4ef8-9eb3-001568b20ed6 service nova] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Received event network-vif-deleted-b825d9b4-15c4-4b47-a3f7-af9838d09458 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:39:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "30aa3eca-5c9f-443a-af70-461010d4e22e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:09 user nova-compute[70374]: INFO nova.compute.manager [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Terminating instance
Jul 27 09:40:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:40:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450795.0397217, ab9c2cd8-7137-4921-b014-5a516da0e249 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:10 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] VM Stopped (Lifecycle Event)
Jul 27 09:40:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-547596c8-328f-40d7-b8b4-c487fb21496a None None] [instance: ab9c2cd8-7137-4921-b014-5a516da0e249] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:40:10 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Instance destroyed successfully.
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lazy-loading 'resources' on Instance uuid 30aa3eca-5c9f-443a-af70-461010d4e22e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1083315878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1083315878',id=15,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7LVTKkV6OndxlbHZqrPuCTqVnrPWGC0Yf+dDzj7YRVKGGE7K+jaweaReXgsGRfDABP3IqlurlpPr2agY7QyFjVleFoaB+gzWVpxdLtiL7Si0bN6oMPicUyfI4Wxs1gxg==',key_name='tempest-keypair-1564014618',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:33:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c072c9f639974ac186a9d8b94baaab20',ramdisk_id='',reservation_id='r-ofzqtwtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-405523215',owner_user_name='tempest-ServerActionsV293TestJSON-405523215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56b56f07f0c4674a09485173c97fd4f',uuid=30aa3eca-5c9f-443a-af70-461010d4e22e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converting VIF {"id": "412b86f3-01b6-4a35-897b-3f886d1444ea", "address": "fa:16:3e:3b:50:77", "network": {"id": "35ac76d9-4950-4370-a2b5-770ea6df435e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-350407877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c072c9f639974ac186a9d8b94baaab20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap412b86f3-01", "ovs_interfaceid": "412b86f3-01b6-4a35-897b-3f886d1444ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:50:77,bridge_name='br-int',has_traffic_filtering=True,id=412b86f3-01b6-4a35-897b-3f886d1444ea,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412b86f3-01') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG os_vif [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:50:77,bridge_name='br-int',has_traffic_filtering=True,id=412b86f3-01b6-4a35-897b-3f886d1444ea,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412b86f3-01') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap412b86f3-01, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:10 user nova-compute[70374]: INFO os_vif [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:50:77,bridge_name='br-int',has_traffic_filtering=True,id=412b86f3-01b6-4a35-897b-3f886d1444ea,network=Network(35ac76d9-4950-4370-a2b5-770ea6df435e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap412b86f3-01')
Jul 27 09:40:10 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Deleting instance files /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e_del
Jul 27 09:40:10 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Deletion of /opt/stack/data/nova/instances/30aa3eca-5c9f-443a-af70-461010d4e22e_del complete
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-3d0bf434-c36e-4a2b-b069-1e5c36aa09f6 req-e2e0ce7a-2817-4644-bf15-ba09ff9705f0 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received event network-vif-unplugged-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3d0bf434-c36e-4a2b-b069-1e5c36aa09f6 req-e2e0ce7a-2817-4644-bf15-ba09ff9705f0 service nova] Acquiring lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3d0bf434-c36e-4a2b-b069-1e5c36aa09f6 req-e2e0ce7a-2817-4644-bf15-ba09ff9705f0 service nova] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3d0bf434-c36e-4a2b-b069-1e5c36aa09f6 req-e2e0ce7a-2817-4644-bf15-ba09ff9705f0 service nova] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-3d0bf434-c36e-4a2b-b069-1e5c36aa09f6 req-e2e0ce7a-2817-4644-bf15-ba09ff9705f0 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] No waiting events found dispatching network-vif-unplugged-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-3d0bf434-c36e-4a2b-b069-1e5c36aa09f6 req-e2e0ce7a-2817-4644-bf15-ba09ff9705f0 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received event network-vif-unplugged-412b86f3-01b6-4a35-897b-3f886d1444ea for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:10 user nova-compute[70374]: INFO nova.compute.manager [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Took 0.68 seconds to destroy the instance on the hypervisor.
Jul 27 09:40:10 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:40:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:40:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:40:11 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450796.7718644, 25214e8a-c626-46a7-b273-eb491c2fc91b => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:11 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] VM Stopped (Lifecycle Event)
Jul 27 09:40:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-55145799-740e-4f99-960f-480a4ff7d3a9 None None] [instance: 25214e8a-c626-46a7-b273-eb491c2fc91b] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updating instance_info_cache with network_info: [{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-5de688f6-7360-4a61-870a-413c658255cf req-2a91a7e7-68c6-43ac-af8f-ad57221b4d88 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received event network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5de688f6-7360-4a61-870a-413c658255cf req-2a91a7e7-68c6-43ac-af8f-ad57221b4d88 service nova] Acquiring lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5de688f6-7360-4a61-870a-413c658255cf req-2a91a7e7-68c6-43ac-af8f-ad57221b4d88 service nova] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5de688f6-7360-4a61-870a-413c658255cf req-2a91a7e7-68c6-43ac-af8f-ad57221b4d88 service nova] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-5de688f6-7360-4a61-870a-413c658255cf req-2a91a7e7-68c6-43ac-af8f-ad57221b4d88 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] No waiting events found dispatching network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:12 user nova-compute[70374]: WARNING nova.compute.manager [req-5de688f6-7360-4a61-870a-413c658255cf req-2a91a7e7-68c6-43ac-af8f-ad57221b4d88 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received unexpected event network-vif-plugged-412b86f3-01b6-4a35-897b-3f886d1444ea for instance with vm_state active and task_state deleting.
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-ebac562b-d239-48e9-b4fa-646f4cac766c req-973b7fe7-ab46-4f81-a678-0af2796abba6 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Received event network-vif-deleted-412b86f3-01b6-4a35-897b-3f886d1444ea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:12 user nova-compute[70374]: INFO nova.compute.manager [req-ebac562b-d239-48e9-b4fa-646f4cac766c req-973b7fe7-ab46-4f81-a678-0af2796abba6 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Neutron deleted interface 412b86f3-01b6-4a35-897b-3f886d1444ea; detaching it from the instance and deleting it from the info cache
Jul 27 09:40:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-ebac562b-d239-48e9-b4fa-646f4cac766c req-973b7fe7-ab46-4f81-a678-0af2796abba6 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:12 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Took 2.31 seconds to deallocate network for instance.
Jul 27 09:40:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-ebac562b-d239-48e9-b4fa-646f4cac766c req-973b7fe7-ab46-4f81-a678-0af2796abba6 service nova] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Detach interface failed, port_id=412b86f3-01b6-4a35-897b-3f886d1444ea, reason: Instance 30aa3eca-5c9f-443a-af70-461010d4e22e could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:13 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Deleted allocations for instance 30aa3eca-5c9f-443a-af70-461010d4e22e
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d1a8d5ad-cc0c-4d1b-bae8-88c66fa48580 tempest-ServerActionsV293TestJSON-405523215 tempest-ServerActionsV293TestJSON-405523215-project-member] Lock "30aa3eca-5c9f-443a-af70-461010d4e22e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.725s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:15 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:40:15 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:40:15 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7275MB free_disk=25.427295684814453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:40:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 69a59942-cd83-4f74-82ea-f23a6538cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 3070aa19-a0a5-40a1-a697-727da1c1cf61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 27316e38-df5e-433e-bd67-719ea7caeab4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 66911d11-4025-4243-9f8e-ff0909460190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance f6f417a6-c890-4372-8471-099eae592990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:40:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "3070aa19-a0a5-40a1-a697-727da1c1cf61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:24 user nova-compute[70374]: INFO nova.compute.manager [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Terminating instance
Jul 27 09:40:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450810.4726405, 30aa3eca-5c9f-443a-af70-461010d4e22e => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:25 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] VM Stopped (Lifecycle Event)
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-e8d76331-0174-4c1e-bbf9-62c775c9e27c req-533594ee-237e-44b0-9330-0200432ed9ec service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received event network-vif-unplugged-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8d76331-0174-4c1e-bbf9-62c775c9e27c req-533594ee-237e-44b0-9330-0200432ed9ec service nova] Acquiring lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8d76331-0174-4c1e-bbf9-62c775c9e27c req-533594ee-237e-44b0-9330-0200432ed9ec service nova] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8d76331-0174-4c1e-bbf9-62c775c9e27c req-533594ee-237e-44b0-9330-0200432ed9ec service nova] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-e8d76331-0174-4c1e-bbf9-62c775c9e27c req-533594ee-237e-44b0-9330-0200432ed9ec service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] No waiting events found dispatching network-vif-unplugged-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-e8d76331-0174-4c1e-bbf9-62c775c9e27c req-533594ee-237e-44b0-9330-0200432ed9ec service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received event network-vif-unplugged-b348d47c-07f5-4d08-a9de-d066adb8116e for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e248eaaa-fb43-4c3a-8514-20094d8b859f None None] [instance: 30aa3eca-5c9f-443a-af70-461010d4e22e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:25 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Instance destroyed successfully.
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lazy-loading 'resources' on Instance uuid 3070aa19-a0a5-40a1-a697-727da1c1cf61 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-868883367',display_name='tempest-VolumesActionsTest-instance-868883367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-868883367',id=24,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:38:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='856989e8171645fc9a6e6c1cbb2358fb',ramdisk_id='',reservation_id='r-vytepbla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1348517842',owner_user_name='tempest-VolumesActionsTest-1348517842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:38:42Z,user_data=None,user_id='7dfadf5215e24c45a8f55022e1cda47b',uuid=3070aa19-a0a5-40a1-a697-727da1c1cf61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converting VIF {"id": "b348d47c-07f5-4d08-a9de-d066adb8116e", "address": "fa:16:3e:c8:22:7e", "network": {"id": "051d4719-34de-4f73-af67-cce302e56037", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1115006223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "856989e8171645fc9a6e6c1cbb2358fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb348d47c-07", "ovs_interfaceid": "b348d47c-07f5-4d08-a9de-d066adb8116e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:22:7e,bridge_name='br-int',has_traffic_filtering=True,id=b348d47c-07f5-4d08-a9de-d066adb8116e,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb348d47c-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG os_vif [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:22:7e,bridge_name='br-int',has_traffic_filtering=True,id=b348d47c-07f5-4d08-a9de-d066adb8116e,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb348d47c-07') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb348d47c-07, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:25 user nova-compute[70374]: INFO os_vif [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:22:7e,bridge_name='br-int',has_traffic_filtering=True,id=b348d47c-07f5-4d08-a9de-d066adb8116e,network=Network(051d4719-34de-4f73-af67-cce302e56037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb348d47c-07')
Jul 27 09:40:25 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Deleting instance files /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61_del
Jul 27 09:40:25 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Deletion of /opt/stack/data/nova/instances/3070aa19-a0a5-40a1-a697-727da1c1cf61_del complete
Jul 27 09:40:25 user nova-compute[70374]: INFO nova.compute.manager [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 27 09:40:25 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:40:25 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:40:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:27 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Took 1.23 seconds to deallocate network for instance.
Jul 27 09:40:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:27 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Deleted allocations for instance 3070aa19-a0a5-40a1-a697-727da1c1cf61
Jul 27 09:40:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddd2af3f-95ee-447f-86db-37e05fe28474 req-47d14149-318a-4180-9183-3fb3e8ec27e9 service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received event network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddd2af3f-95ee-447f-86db-37e05fe28474 req-47d14149-318a-4180-9183-3fb3e8ec27e9 service nova] Acquiring lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddd2af3f-95ee-447f-86db-37e05fe28474 req-47d14149-318a-4180-9183-3fb3e8ec27e9 service nova] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ddd2af3f-95ee-447f-86db-37e05fe28474 req-47d14149-318a-4180-9183-3fb3e8ec27e9 service nova] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddd2af3f-95ee-447f-86db-37e05fe28474 req-47d14149-318a-4180-9183-3fb3e8ec27e9 service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] No waiting events found dispatching network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:27 user nova-compute[70374]: WARNING nova.compute.manager [req-ddd2af3f-95ee-447f-86db-37e05fe28474 req-47d14149-318a-4180-9183-3fb3e8ec27e9 service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received unexpected event network-vif-plugged-b348d47c-07f5-4d08-a9de-d066adb8116e for instance with vm_state deleted and task_state None.
Jul 27 09:40:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-ddd2af3f-95ee-447f-86db-37e05fe28474 req-47d14149-318a-4180-9183-3fb3e8ec27e9 service nova] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Received event network-vif-deleted-b348d47c-07f5-4d08-a9de-d066adb8116e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6b3f79e0-502a-4759-b44c-9531f2dc3484 tempest-VolumesActionsTest-1348517842 tempest-VolumesActionsTest-1348517842-project-member] Lock "3070aa19-a0a5-40a1-a697-727da1c1cf61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.594s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d277ac0-79cf-4ad5-b9cc-5646ab2b0c0c req-df1ec258-c2a7-4b76-a905-4cf041dd803b service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-changed-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-6d277ac0-79cf-4ad5-b9cc-5646ab2b0c0c req-df1ec258-c2a7-4b76-a905-4cf041dd803b service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing instance network info cache due to event network-changed-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:40:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d277ac0-79cf-4ad5-b9cc-5646ab2b0c0c req-df1ec258-c2a7-4b76-a905-4cf041dd803b service nova] Acquiring lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d277ac0-79cf-4ad5-b9cc-5646ab2b0c0c req-df1ec258-c2a7-4b76-a905-4cf041dd803b service nova] Acquired lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d277ac0-79cf-4ad5-b9cc-5646ab2b0c0c req-df1ec258-c2a7-4b76-a905-4cf041dd803b service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Refreshing network info cache for port 6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:40:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d277ac0-79cf-4ad5-b9cc-5646ab2b0c0c req-df1ec258-c2a7-4b76-a905-4cf041dd803b service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updated VIF entry in instance network info cache for port 6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:40:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-6d277ac0-79cf-4ad5-b9cc-5646ab2b0c0c req-df1ec258-c2a7-4b76-a905-4cf041dd803b service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [{"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6d277ac0-79cf-4ad5-b9cc-5646ab2b0c0c req-df1ec258-c2a7-4b76-a905-4cf041dd803b service nova] Releasing lock "refresh_cache-27316e38-df5e-433e-bd67-719ea7caeab4" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "27316e38-df5e-433e-bd67-719ea7caeab4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:35 user nova-compute[70374]: INFO nova.compute.manager [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Terminating instance
Jul 27 09:40:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:40:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-bc3bc665-b760-495c-ac80-a887fa3e5ef6 req-08d53d72-539c-4aa0-9c36-5ad960325475 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc3bc665-b760-495c-ac80-a887fa3e5ef6 req-08d53d72-539c-4aa0-9c36-5ad960325475 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc3bc665-b760-495c-ac80-a887fa3e5ef6 req-08d53d72-539c-4aa0-9c36-5ad960325475 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc3bc665-b760-495c-ac80-a887fa3e5ef6 req-08d53d72-539c-4aa0-9c36-5ad960325475 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-bc3bc665-b760-495c-ac80-a887fa3e5ef6 req-08d53d72-539c-4aa0-9c36-5ad960325475 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-unplugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-bc3bc665-b760-495c-ac80-a887fa3e5ef6 req-08d53d72-539c-4aa0-9c36-5ad960325475 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-881468db-a08d-4061-a821-efc6f0c5431a req-04c41499-b8ea-445b-ab98-af52b4acc8e3 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-881468db-a08d-4061-a821-efc6f0c5431a req-04c41499-b8ea-445b-ab98-af52b4acc8e3 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-881468db-a08d-4061-a821-efc6f0c5431a req-04c41499-b8ea-445b-ab98-af52b4acc8e3 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-881468db-a08d-4061-a821-efc6f0c5431a req-04c41499-b8ea-445b-ab98-af52b4acc8e3 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-881468db-a08d-4061-a821-efc6f0c5431a req-04c41499-b8ea-445b-ab98-af52b4acc8e3 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-unplugged-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-881468db-a08d-4061-a821-efc6f0c5431a req-04c41499-b8ea-445b-ab98-af52b4acc8e3 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-fd818b43-d661-467a-b885-7a67f78bc578 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-249b8417-dc14-4473-a157-976c353c1dbc req-3f538ac1-e708-4a47-b851-1313fd31bec1 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-249b8417-dc14-4473-a157-976c353c1dbc req-3f538ac1-e708-4a47-b851-1313fd31bec1 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-249b8417-dc14-4473-a157-976c353c1dbc req-3f538ac1-e708-4a47-b851-1313fd31bec1 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-249b8417-dc14-4473-a157-976c353c1dbc req-3f538ac1-e708-4a47-b851-1313fd31bec1 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-249b8417-dc14-4473-a157-976c353c1dbc req-3f538ac1-e708-4a47-b851-1313fd31bec1 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-unplugged-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-249b8417-dc14-4473-a157-976c353c1dbc req-3f538ac1-e708-4a47-b851-1313fd31bec1 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-e82a7a06-2db3-48f1-883e-2253df574d5e for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:37 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Instance destroyed successfully.
Jul 27 09:40:37 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lazy-loading 'resources' on Instance uuid 27316e38-df5e-433e-bd67-719ea7caeab4 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b,network=Network(a3e3545b-d3df-49cc-8c8a-a08a99bb69d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ccd9110-0b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b,network=Network(a3e3545b-d3df-49cc-8c8a-a08a99bb69d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ccd9110-0b') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ccd9110-0b, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: INFO os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b,network=Network(a3e3545b-d3df-49cc-8c8a-a08a99bb69d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ccd9110-0b')
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:76:8d,bridge_name='br-int',has_traffic_filtering=True,id=e82a7a06-2db3-48f1-883e-2253df574d5e,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape82a7a06-2d') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:76:8d,bridge_name='br-int',has_traffic_filtering=True,id=e82a7a06-2db3-48f1-883e-2253df574d5e,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape82a7a06-2d') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape82a7a06-2d, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: INFO os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:76:8d,bridge_name='br-int',has_traffic_filtering=True,id=e82a7a06-2db3-48f1-883e-2253df574d5e,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape82a7a06-2d')
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9f:e0,bridge_name='br-int',has_traffic_filtering=True,id=fd818b43-d661-467a-b885-7a67f78bc578,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd818b43-d6') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9f:e0,bridge_name='br-int',has_traffic_filtering=True,id=fd818b43-d661-467a-b885-7a67f78bc578,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd818b43-d6') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd818b43-d6, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: INFO os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9f:e0,bridge_name='br-int',has_traffic_filtering=True,id=fd818b43-d661-467a-b885-7a67f78bc578,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd818b43-d6')
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:30,bridge_name='br-int',has_traffic_filtering=True,id=296190d8-e4e1-4d98-9c48-b588d5fa4157,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296190d8-e4') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:30,bridge_name='br-int',has_traffic_filtering=True,id=296190d8-e4e1-4d98-9c48-b588d5fa4157,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296190d8-e4') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap296190d8-e4, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: INFO os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:30,bridge_name='br-int',has_traffic_filtering=True,id=296190d8-e4e1-4d98-9c48-b588d5fa4157,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap296190d8-e4')
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4b7b0f-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4b7b0f-0c') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad4b7b0f-0c, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: INFO os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9,network=Network(e0aadd12-7be5-419e-9b9e-166dae88fbb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4b7b0f-0c')
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7a:27,bridge_name='br-int',has_traffic_filtering=True,id=b019f062-cc3b-4d3f-bb48-553ff5ccc6ce,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb019f062-cc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7a:27,bridge_name='br-int',has_traffic_filtering=True,id=b019f062-cc3b-4d3f-bb48-553ff5ccc6ce,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb019f062-cc') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb019f062-cc, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: INFO os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7a:27,bridge_name='br-int',has_traffic_filtering=True,id=b019f062-cc3b-4d3f-bb48-553ff5ccc6ce,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb019f062-cc')
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T09:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106722277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106722277',id=25,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRGuGLAMWhpLlwfi+RjY4jRiN1SpnLR35KKIqRvnBtG+KcY5bT3wCgJ2ndXzhb3MjdHWkDaR5Yjx4T75+LCtpg632mnX625GljVhZMLdbnLOZnvO+eSPtVeAqQ7yqSDsQ==',key_name='tempest-keypair-625840588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64a77073d6849c2a31d4acd7eb389eb',ramdisk_id='',reservation_id='r-hq52jvjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-645937837',owner_user_name='tempest-TaggedBootDevicesTest_v242-645937837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0edfda9256e04349bf903c0d13168ca2',uuid=27316e38-df5e-433e-bd67-719ea7caeab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converting VIF {"id": "18cc95e6-69da-48ba-a8f0-069677e917ad", "address": "fa:16:3e:e5:2f:ca", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18cc95e6-69", "ovs_interfaceid": "18cc95e6-69da-48ba-a8f0-069677e917ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:2f:ca,bridge_name='br-int',has_traffic_filtering=True,id=18cc95e6-69da-48ba-a8f0-069677e917ad,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18cc95e6-69') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:2f:ca,bridge_name='br-int',has_traffic_filtering=True,id=18cc95e6-69da-48ba-a8f0-069677e917ad,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18cc95e6-69') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18cc95e6-69, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:38 user nova-compute[70374]: INFO os_vif [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:2f:ca,bridge_name='br-int',has_traffic_filtering=True,id=18cc95e6-69da-48ba-a8f0-069677e917ad,network=Network(4f1a2e5a-93ad-4bdf-a638-eee914a26bbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18cc95e6-69')
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYFxqcJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:40:38 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c529272f-ff1b-4b61-8727-a18d095bac35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:40:38 user nova-compute[70374]: No targets found.
Jul 27 09:40:38 user nova-compute[70374]: iSNS:
Jul 27 09:40:38 user nova-compute[70374]: No targets found.
Jul 27 09:40:38 user nova-compute[70374]: STATIC:
Jul 27 09:40:38 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5
Jul 27 09:40:38 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:38 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:38 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed
Jul 27 09:40:38 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:38 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:38 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45
Jul 27 09:40:38 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:38 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:38 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:40:38 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:38 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:38 user nova-compute[70374]: FIRMWARE:
Jul 27 09:40:38 user nova-compute[70374]: No targets found.
Jul 27 09:40:38 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:40:38 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:40:38 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: WARNING nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b for instance with vm_state active and task_state deleting.
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-unplugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: WARNING nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce for instance with vm_state active and task_state deleting.
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-unplugged-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-5fa31472-5c64-4f9b-b3ca-758ee353c843 req-b26fbee6-c9ae-45b6-8160-b12ddda538a9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-18cc95e6-69da-48ba-a8f0-069677e917ad for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e36a87f-07f1-4e22-8da8-31aa2b1844c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd28ebe1-cf66-404d-b420-314ff636782a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5df520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07a16c-afe4-425d-8005-f7d328f22217]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a13ff0-a7c0-40fc-95fa-e5e8fe0e6728]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a54394f-b547-4d60-9542-6db2bed949cf]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ccbd2-e53b-4050-9e1b-4fe7fc03783c]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e460ed-3b04-4ed1-a216-e259087a9890]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3088e2-e79f-43d6-a36c-84acdcd69a3a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5, portal: 172.16.0.220,3260]
Jul 27 09:40:38 user nova-compute[70374]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5, portal: 172.16.0.220,3260] successful.
Jul 27 09:40:38 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c858282f-5798-4275-98d4-8b5a5a8e7ac5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba91ddd-6aad-4d24-a780-649536e5241b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== disconnect_volume: return (399ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APSnbTQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:40:38 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[422b32ae-7f10-4a09-8786-149aab0aff48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:40:38 user nova-compute[70374]: No targets found.
Jul 27 09:40:38 user nova-compute[70374]: iSNS:
Jul 27 09:40:38 user nova-compute[70374]: No targets found.
Jul 27 09:40:38 user nova-compute[70374]: STATIC:
Jul 27 09:40:38 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed
Jul 27 09:40:38 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:38 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:38 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45
Jul 27 09:40:38 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:38 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:38 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:40:38 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:38 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:38 user nova-compute[70374]: FIRMWARE:
Jul 27 09:40:38 user nova-compute[70374]: No targets found.
Jul 27 09:40:38 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:40:38 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:40:38 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f27e0ad-f995-4bb8-a8ff-447da9b16a4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: WARNING nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-fd818b43-d661-467a-b885-7a67f78bc578 for instance with vm_state active and task_state deleting.
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-unplugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: WARNING nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-296190d8-e4e1-4d98-9c48-b588d5fa4157 for instance with vm_state active and task_state deleting.
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-unplugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-unplugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:38 user nova-compute[70374]: WARNING nova.compute.manager [req-fdf93a38-b573-440a-9316-a8a002fd581b req-97913d95-8f71-44d2-9757-893becfa3ab9 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 for instance with vm_state active and task_state deleting.
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f298607-ef86-407d-9b27-ac7922cd4c3e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:38 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5dd990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e9e0fa-f6dc-4c7d-9c2c-691500f51729]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[212994ea-55c8-4cb9-a082-40c19279b02a]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[908a6a6f-3b5b-4dfb-88a8-b089b9f74495]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe83538b-d793-45d7-b99d-1c1ce68d1acd]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5750a05a-7a21-448d-9b1f-aa9442ba516b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfe6515-6f34-4bf1-b324-468df06ae048]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed, portal: 172.16.0.220,3260]
Jul 27 09:40:39 user nova-compute[70374]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed, portal: 172.16.0.220,3260] successful.
Jul 27 09:40:39 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c42b0d80-658e-4dbd-b383-80edaea79aed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f9037-024c-407d-9b87-57b18ad7e8b1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== disconnect_volume: return (330ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYlSthQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:40:39 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[be847df1-2e95-40a1-9c79-c567bd6aa070]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:40:39 user nova-compute[70374]: No targets found.
Jul 27 09:40:39 user nova-compute[70374]: iSNS:
Jul 27 09:40:39 user nova-compute[70374]: No targets found.
Jul 27 09:40:39 user nova-compute[70374]: STATIC:
Jul 27 09:40:39 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45
Jul 27 09:40:39 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:39 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:39 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:40:39 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:40:39 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:40:39 user nova-compute[70374]: FIRMWARE:
Jul 27 09:40:39 user nova-compute[70374]: No targets found.
Jul 27 09:40:39 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:40:39 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:40:39 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb052f74-f0db-41d9-be26-4d18b904a6db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd142198-1a45-4ae0-b821-6c065f77a09d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:40:39 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:39 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 (non-flash)
Jul 27 09:40:39 user nova-compute[70374]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:39 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5f1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45'): ({'sde'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Removing single pathed devices sde {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73be95b-395f-45de-8b71-faddda4946da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7be6c91-f113-49d8-b727-f80de0b56317]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Flushing IO for device /dev/sde {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df12d7-d3ad-4106-9ab9-8b696f729a3f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-b48057b5-0435-4ce8-8ba0-a6a78ce0ef8d req-d2a7d659-98ab-4435-9bcb-ba14bc22a891 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b48057b5-0435-4ce8-8ba0-a6a78ce0ef8d req-d2a7d659-98ab-4435-9bcb-ba14bc22a891 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b48057b5-0435-4ce8-8ba0-a6a78ce0ef8d req-d2a7d659-98ab-4435-9bcb-ba14bc22a891 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b48057b5-0435-4ce8-8ba0-a6a78ce0ef8d req-d2a7d659-98ab-4435-9bcb-ba14bc22a891 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-b48057b5-0435-4ce8-8ba0-a6a78ce0ef8d req-d2a7d659-98ab-4435-9bcb-ba14bc22a891 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:39 user nova-compute[70374]: WARNING nova.compute.manager [req-b48057b5-0435-4ce8-8ba0-a6a78ce0ef8d req-d2a7d659-98ab-4435-9bcb-ba14bc22a891 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-e82a7a06-2db3-48f1-883e-2253df574d5e for instance with vm_state active and task_state deleting.
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[619d7a88-209e-43eb-b527-99024fb7c96c]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22346f7-3bef-41b3-9996-48ef70557ef8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[244d9b03-1beb-4bce-a791-e4e58ec90a9e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45, portal: 172.16.0.220,3260]
Jul 27 09:40:39 user nova-compute[70374]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45, portal: 172.16.0.220,3260] successful.
Jul 27 09:40:39 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44581260-7d1e-4f1b-b449-181a52fc3e45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c4ab9-46ba-4a7f-92be-577f3e17474a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] <== disconnect_volume: return (331ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:40:39 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Deleting instance files /opt/stack/data/nova/instances/27316e38-df5e-433e-bd67-719ea7caeab4_del
Jul 27 09:40:39 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Deletion of /opt/stack/data/nova/instances/27316e38-df5e-433e-bd67-719ea7caeab4_del complete
Jul 27 09:40:39 user nova-compute[70374]: INFO nova.compute.manager [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Took 3.57 seconds to destroy the instance on the hypervisor.
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.objects.instance [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'flavor' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:39 user nova-compute[70374]: INFO nova.compute.manager [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Attaching volume e596a883-20cb-4fe1-ad7c-5999f23ba940 to /dev/vdb
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.utils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[32330dc3-8728-4bef-bee1-c0e66e0a4cdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afd2d6c-8196-4d4c-b24d-baf750badeb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfe6498-4dae-4b4f-8eb5-4ec00f94c41a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bfa798-d941-4440-8319-9d2267e9311b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:40:39 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:40:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5aae39-5c56-4c48-af15-58d4d367c16c]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG os_brick.utils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:40:39 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating existing volume attachment record: 35e5bbfa-bfdc-44de-bd7c-e657a4b18c6b {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] Acquiring lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] Lock "27316e38-df5e-433e-bd67-719ea7caeab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] No waiting events found dispatching network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:40 user nova-compute[70374]: WARNING nova.compute.manager [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received unexpected event network-vif-plugged-18cc95e6-69da-48ba-a8f0-069677e917ad for instance with vm_state active and task_state deleting.
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-changed-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Refreshing instance network info cache due to event network-changed-c5e7d75d-7b90-4a67-a548-f829c290e294. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] Acquiring lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] Acquired lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Refreshing network info cache for port c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450825.7548535, 3070aa19-a0a5-40a1-a697-727da1c1cf61 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:40 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] VM Stopped (Lifecycle Event)
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9e88ccd0-8c86-421f-a251-443d66458148 None None] [instance: 3070aa19-a0a5-40a1-a697-727da1c1cf61] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updated VIF entry in instance network info cache for port c5e7d75d-7b90-4a67-a548-f829c290e294. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69b67ac1-0365-4896-ac9c-d7ff3d83364c req-32d50d07-051b-49cf-947a-d57c2d071ab6 service nova] Releasing lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-73e8c898-467f-45d3-95aa-7ba177f97e4d req-85c1f207-2111-473d-acf3-c0da40c13aa8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-deleted-18cc95e6-69da-48ba-a8f0-069677e917ad {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:42 user nova-compute[70374]: INFO nova.compute.manager [req-73e8c898-467f-45d3-95aa-7ba177f97e4d req-85c1f207-2111-473d-acf3-c0da40c13aa8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Neutron deleted interface 18cc95e6-69da-48ba-a8f0-069677e917ad; detaching it from the instance and deleting it from the info cache
Jul 27 09:40:42 user nova-compute[70374]: DEBUG nova.network.neutron [req-73e8c898-467f-45d3-95aa-7ba177f97e4d req-85c1f207-2111-473d-acf3-c0da40c13aa8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [{"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "address": "fa:16:3e:ec:fc:03", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4b7b0f-0c", "ovs_interfaceid": "ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-73e8c898-467f-45d3-95aa-7ba177f97e4d req-85c1f207-2111-473d-acf3-c0da40c13aa8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Detach interface failed, port_id=18cc95e6-69da-48ba-a8f0-069677e917ad, reason: Instance 27316e38-df5e-433e-bd67-719ea7caeab4 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:40:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-73e8c898-467f-45d3-95aa-7ba177f97e4d req-85c1f207-2111-473d-acf3-c0da40c13aa8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-deleted-ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:42 user nova-compute[70374]: INFO nova.compute.manager [req-73e8c898-467f-45d3-95aa-7ba177f97e4d req-85c1f207-2111-473d-acf3-c0da40c13aa8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Neutron deleted interface ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9; detaching it from the instance and deleting it from the info cache
Jul 27 09:40:42 user nova-compute[70374]: DEBUG nova.network.neutron [req-73e8c898-467f-45d3-95aa-7ba177f97e4d req-85c1f207-2111-473d-acf3-c0da40c13aa8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [{"id": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "address": "fa:16:3e:c1:9b:88", "network": {"id": "a3e3545b-d3df-49cc-8c8a-a08a99bb69d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-468632138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ccd9110-0b", "ovs_interfaceid": "6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e82a7a06-2db3-48f1-883e-2253df574d5e", "address": "fa:16:3e:8e:76:8d", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82a7a06-2d", "ovs_interfaceid": "e82a7a06-2db3-48f1-883e-2253df574d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd818b43-d661-467a-b885-7a67f78bc578", "address": "fa:16:3e:42:9f:e0", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd818b43-d6", "ovs_interfaceid": "fd818b43-d661-467a-b885-7a67f78bc578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "address": "fa:16:3e:6e:34:30", "network": {"id": "e0aadd12-7be5-419e-9b9e-166dae88fbb0", "bridge": "br-int", "label": "tempest-device-tagging-net1-886912872", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap296190d8-e4", "ovs_interfaceid": "296190d8-e4e1-4d98-9c48-b588d5fa4157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "address": "fa:16:3e:cf:7a:27", "network": {"id": "4f1a2e5a-93ad-4bdf-a638-eee914a26bbb", "bridge": "br-int", "label": "tempest-device-tagging-net2-875829143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64a77073d6849c2a31d4acd7eb389eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb019f062-cc", "ovs_interfaceid": "b019f062-cc3b-4d3f-bb48-553ff5ccc6ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-73e8c898-467f-45d3-95aa-7ba177f97e4d req-85c1f207-2111-473d-acf3-c0da40c13aa8 service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Detach interface failed, port_id=ad4b7b0f-0caa-4f18-8feb-90d8e98dfcb9, reason: Instance 27316e38-df5e-433e-bd67-719ea7caeab4 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:40:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:43 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:43 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Took 4.26 seconds to deallocate network for instance.
Jul 27 09:40:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-4c70dcab-846c-4066-9946-b053bc794ae4 req-fd6c03f1-e198-4bda-bb15-b326af87df8d service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-deleted-6ccd9110-0b0b-4270-a9b8-ed9f4d05c05b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-4c70dcab-846c-4066-9946-b053bc794ae4 req-fd6c03f1-e198-4bda-bb15-b326af87df8d service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-deleted-b019f062-cc3b-4d3f-bb48-553ff5ccc6ce {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-4c70dcab-846c-4066-9946-b053bc794ae4 req-fd6c03f1-e198-4bda-bb15-b326af87df8d service nova] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Received event network-vif-deleted-296190d8-e4e1-4d98-9c48-b588d5fa4157 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXxBSjJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:40:47 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:40:47 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:40:47 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[290a0f44-964b-450c-b1aa-5b9764e7f7c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:40:47 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e485f5d-17bb-4371-a38a-15feb71c115a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940] added
Jul 27 09:40:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[32abf05b-8b00-4c50-a4fa-6adc600e2b1a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[37531b9f-e3bc-426c-b1a5-ccc7009182ba]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXxBSjJh {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXxBSjJh" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[736a0f45-8dcd-43cb-a030-bbfa80c8208e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VXxBSjJh'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a47ac8e-4f45-4f6a-932d-f402c8741200]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[779715da-bf6e-4bce-88cc-2007503ec313]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f67785-38ab-47d2-a6d2-025134c12f6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940, portal: 172.16.0.220,3260]
Jul 27 09:40:47 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940, portal: 172.16.0.220,3260] successful.
Jul 27 09:40:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[85753441-3e86-4247-bad0-d21a6a602fbb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb63f354-c300-4939-b7da-f4f6135a03fc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:47 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:40:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:47 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:40:47 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0931cf-4d83-4249-a817-d1a93d69db86]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:47 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXxBSjJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23537653838653865', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653838653865', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'flavor' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:40:48 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:40:48 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:40:48 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:40:48 user nova-compute[70374]:   <serial>e596a883-20cb-4fe1-ad7c-5999f23ba940</serial>
Jul 27 09:40:48 user nova-compute[70374]: </disk>
Jul 27 09:40:48 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No VIF found with MAC fa:16:3e:02:4c:b3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:40:49 user nova-compute[70374]: INFO nova.compute.claims [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Claim successful on node user
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-97e4e5ae-2518-4f3a-8ebb-184a13a002e2 req-9a710cca-f964-432b-b600-866950774547 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received event network-changed-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-97e4e5ae-2518-4f3a-8ebb-184a13a002e2 req-9a710cca-f964-432b-b600-866950774547 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Refreshing instance network info cache due to event network-changed-c30631f7-4236-40e8-8c15-15a6a1d94eaa. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-97e4e5ae-2518-4f3a-8ebb-184a13a002e2 req-9a710cca-f964-432b-b600-866950774547 service nova] Acquiring lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-97e4e5ae-2518-4f3a-8ebb-184a13a002e2 req-9a710cca-f964-432b-b600-866950774547 service nova] Acquired lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.network.neutron [req-97e4e5ae-2518-4f3a-8ebb-184a13a002e2 req-9a710cca-f964-432b-b600-866950774547 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Refreshing network info cache for port c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692fc7af-534d-4ec5-94ca-678ab8c1e936 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.420s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'flavor' on Instance uuid f6f417a6-c890-4372-8471-099eae592990 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:40:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Ignoring supplied device name: /dev/vdb
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:40:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:40:49 user nova-compute[70374]: INFO nova.compute.manager [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Took 5.98 seconds to detach 3 volumes for instance.
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:49 user nova-compute[70374]: INFO nova.compute.manager [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Attaching volume 58667d65-004b-42f3-a627-9750c51ef372 to /dev/vdb
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.policy [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c1d49c23b0045d881d9f47e33447162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfaa69b3745a435795aa636ccddec3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:40:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Creating image(s)
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "/opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "/opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "/opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:49 user nova-compute[70374]: INFO nova.compute.manager [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Rescuing
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquired lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG os_brick.utils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[db674fcf-048d-427f-9129-b2de930c2926]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc06203-9fd6-46ba-8d69-3b3253de780e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[db78cffe-f587-433d-8460-e678fa7f2a17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c7eba9-c5f3-4193-ae43-4c696b41d5be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.194s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:40:50 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f148ff6-0132-4d57-bdfe-ca388d2b981a]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG os_brick.utils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Updating existing volume attachment record: 4eceeb9c-55aa-449b-aac0-60e706a5808f {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.network.neutron [req-97e4e5ae-2518-4f3a-8ebb-184a13a002e2 req-9a710cca-f964-432b-b600-866950774547 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Updated VIF entry in instance network info cache for port c30631f7-4236-40e8-8c15-15a6a1d94eaa. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.network.neutron [req-97e4e5ae-2518-4f3a-8ebb-184a13a002e2 req-9a710cca-f964-432b-b600-866950774547 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Updating instance_info_cache with network_info: [{"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-97e4e5ae-2518-4f3a-8ebb-184a13a002e2 req-9a710cca-f964-432b-b600-866950774547 service nova] Releasing lock "refresh_cache-f6f417a6-c890-4372-8471-099eae592990" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk 1073741824" returned: 0 in 0.060s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.592s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:50 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Deleted allocations for instance 27316e38-df5e-433e-bd67-719ea7caeab4
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Cannot resize image /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'migration_context' on Instance uuid 38e29c83-3067-492a-9b4c-953f5344ba2a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Ensure instance console log exists: /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d05e30e3-0583-4225-b6b7-268e53617618 tempest-TaggedBootDevicesTest_v242-645937837 tempest-TaggedBootDevicesTest_v242-645937837-project-member] Lock "27316e38-df5e-433e-bd67-719ea7caeab4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.669s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Successfully created port: e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Releasing lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-ecb0ae29-aab2-47b0-94d1-fb3171ab6167 req-a15153cd-a6b5-4c03-827a-cf8d1f1d410b service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ecb0ae29-aab2-47b0-94d1-fb3171ab6167 req-a15153cd-a6b5-4c03-827a-cf8d1f1d410b service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ecb0ae29-aab2-47b0-94d1-fb3171ab6167 req-a15153cd-a6b5-4c03-827a-cf8d1f1d410b service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ecb0ae29-aab2-47b0-94d1-fb3171ab6167 req-a15153cd-a6b5-4c03-827a-cf8d1f1d410b service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-ecb0ae29-aab2-47b0-94d1-fb3171ab6167 req-a15153cd-a6b5-4c03-827a-cf8d1f1d410b service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:51 user nova-compute[70374]: WARNING nova.compute.manager [req-ecb0ae29-aab2-47b0-94d1-fb3171ab6167 req-a15153cd-a6b5-4c03-827a-cf8d1f1d410b service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state active and task_state rescuing.
Jul 27 09:40:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:52 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance destroyed successfully.
Jul 27 09:40:52 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Attempting rescue
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70374) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance directory exists: not creating {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 09:40:52 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Creating image(s)
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'trusted_certs' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Successfully updated port: e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-e565e813-9069-4e50-9d20-ec1caf305107 req-c5a65373-b538-46a1-8f51-9e1a8e21e62a service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received event network-changed-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-e565e813-9069-4e50-9d20-ec1caf305107 req-c5a65373-b538-46a1-8f51-9e1a8e21e62a service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Refreshing instance network info cache due to event network-changed-e9b57f91-ad8d-4146-a6e4-9138309aa071. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e565e813-9069-4e50-9d20-ec1caf305107 req-c5a65373-b538-46a1-8f51-9e1a8e21e62a service nova] Acquiring lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e565e813-9069-4e50-9d20-ec1caf305107 req-c5a65373-b538-46a1-8f51-9e1a8e21e62a service nova] Acquired lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-e565e813-9069-4e50-9d20-ec1caf305107 req-c5a65373-b538-46a1-8f51-9e1a8e21e62a service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Refreshing network info cache for port e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue" returned: 0 in 0.062s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'migration_context' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Start _get_guest_xml network_info=[{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:02:4c:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '35458adf-261a-4e0b-a4db-b243619b2394', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'resources' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'numa_topology' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:40:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-e565e813-9069-4e50-9d20-ec1caf305107 req-c5a65373-b538-46a1-8f51-9e1a8e21e62a service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1128759625',display_name='tempest-ServerRescueNegativeTestJSON-server-1128759625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1128759625',id=26,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZj+k3Bgy7oCtHJzEs2H3+NxtBrthZmd6r3Jc2RDUxkkti9jy66392CRnCtb3zi3qP5p5VGM/NEkUBAuG/ZEYZAP/D4yV5s2fCbg7QBbglGQvwL3bBpZRdJLzIVLbkOqA==',key_name='tempest-keypair-601043870',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:38:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-a1q2nab0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:38:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=66911d11-4025-4243-9f8e-ff0909460190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:02:4c:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "vif_mac": "fa:16:3e:02:4c:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c5e7d75d-7b90-4a67-a548-f829c290e294,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e7d75d-7b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'pci_devices' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:40:52 user nova-compute[70374]:   <uuid>66911d11-4025-4243-9f8e-ff0909460190</uuid>
Jul 27 09:40:52 user nova-compute[70374]:   <name>instance-0000001a</name>
Jul 27 09:40:52 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:40:52 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:40:52 user nova-compute[70374]:   <metadata>
Jul 27 09:40:52 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:40:52 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:40:52 user nova-compute[70374]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1128759625</nova:name>
Jul 27 09:40:52 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:40:52</nova:creationTime>
Jul 27 09:40:52 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:40:52 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:40:52 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:40:52 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:40:52 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:40:52 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:40:52 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:40:52 user nova-compute[70374]:       <nova:owner>
Jul 27 09:40:52 user nova-compute[70374]:         <nova:user uuid="d059c8dff3644f3c9c0c54498a4d78f7">tempest-ServerRescueNegativeTestJSON-241559119-project-member</nova:user>
Jul 27 09:40:52 user nova-compute[70374]:         <nova:project uuid="d8acda82ef3f428fbb93847922a213d1">tempest-ServerRescueNegativeTestJSON-241559119</nova:project>
Jul 27 09:40:52 user nova-compute[70374]:       </nova:owner>
Jul 27 09:40:52 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:40:52 user nova-compute[70374]:       <nova:ports>
Jul 27 09:40:52 user nova-compute[70374]:         <nova:port uuid="c5e7d75d-7b90-4a67-a548-f829c290e294">
Jul 27 09:40:52 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 09:40:52 user nova-compute[70374]:         </nova:port>
Jul 27 09:40:52 user nova-compute[70374]:       </nova:ports>
Jul 27 09:40:52 user nova-compute[70374]:     </nova:instance>
Jul 27 09:40:52 user nova-compute[70374]:   </metadata>
Jul 27 09:40:52 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:40:52 user nova-compute[70374]:     <system>
Jul 27 09:40:52 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:40:52 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:40:52 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:40:52 user nova-compute[70374]:       <entry name="serial">66911d11-4025-4243-9f8e-ff0909460190</entry>
Jul 27 09:40:52 user nova-compute[70374]:       <entry name="uuid">66911d11-4025-4243-9f8e-ff0909460190</entry>
Jul 27 09:40:52 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:40:52 user nova-compute[70374]:     </system>
Jul 27 09:40:52 user nova-compute[70374]:   </sysinfo>
Jul 27 09:40:52 user nova-compute[70374]:   <os>
Jul 27 09:40:52 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:40:52 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:40:52 user nova-compute[70374]:   </os>
Jul 27 09:40:52 user nova-compute[70374]:   <features>
Jul 27 09:40:52 user nova-compute[70374]:     <acpi/>
Jul 27 09:40:52 user nova-compute[70374]:     <apic/>
Jul 27 09:40:52 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:40:52 user nova-compute[70374]:   </features>
Jul 27 09:40:52 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:40:52 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:40:52 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:40:52 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:40:52 user nova-compute[70374]:   </clock>
Jul 27 09:40:52 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:40:52 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:40:52 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:40:52 user nova-compute[70374]:   </cpu>
Jul 27 09:40:52 user nova-compute[70374]:   <devices>
Jul 27 09:40:52 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:40:52 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:40:52 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue"/>
Jul 27 09:40:52 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:40:52 user nova-compute[70374]:     </disk>
Jul 27 09:40:52 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:40:52 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:40:52 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk"/>
Jul 27 09:40:52 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:40:52 user nova-compute[70374]:     </disk>
Jul 27 09:40:52 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:40:52 user nova-compute[70374]:       <mac address="fa:16:3e:02:4c:b3"/>
Jul 27 09:40:52 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:40:52 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:40:52 user nova-compute[70374]:       <target dev="tapc5e7d75d-7b"/>
Jul 27 09:40:52 user nova-compute[70374]:     </interface>
Jul 27 09:40:52 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:40:52 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/console.log" append="off"/>
Jul 27 09:40:52 user nova-compute[70374]:     </serial>
Jul 27 09:40:52 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:40:52 user nova-compute[70374]:     <video>
Jul 27 09:40:52 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:40:52 user nova-compute[70374]:     </video>
Jul 27 09:40:52 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:40:52 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:40:52 user nova-compute[70374]:     </rng>
Jul 27 09:40:52 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:40:52 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:40:52 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:40:52 user nova-compute[70374]:     </memballoon>
Jul 27 09:40:52 user nova-compute[70374]:   </devices>
Jul 27 09:40:52 user nova-compute[70374]: </domain>
Jul 27 09:40:52 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:40:52 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance destroyed successfully.
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] No VIF found with MAC fa:16:3e:02:4c:b3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-e565e813-9069-4e50-9d20-ec1caf305107 req-c5a65373-b538-46a1-8f51-9e1a8e21e62a service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e565e813-9069-4e50-9d20-ec1caf305107 req-c5a65373-b538-46a1-8f51-9e1a8e21e62a service nova] Releasing lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquired lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450837.9038224, 27316e38-df5e-433e-bd67-719ea7caeab4 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:52 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] VM Stopped (Lifecycle Event)
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-75bf9a4e-6b40-46a0-8f8c-89a6eb41d5c0 None None] [instance: 27316e38-df5e-433e-bd67-719ea7caeab4] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:52 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:40:52 user nova-compute[70374]: INFO nova.compute.claims [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Claim successful on node user
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Updating instance_info_cache with network_info: [{"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Releasing lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Instance network_info: |[{"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Start _get_guest_xml network_info=[{"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:40:53 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:40:53 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-54880262',display_name='tempest-AttachVolumeNegativeTest-server-54880262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-54880262',id=28,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxydFxQntbmTuUdQYD1Xo27+bgVUXwgIBmPkoHTQLikz9TupV1eXN+VwwU1N9ducgIvEOTYpiao4N4Bhqbe6KM/p9HYZ+d2by0aWc2RUevQ77SF29HkGqN5t2FlJ0vsaw==',key_name='tempest-keypair-358103055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-ahqymeam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=38e29c83-3067-492a-9b4c-953f5344ba2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:36:72,bridge_name='br-int',has_traffic_filtering=True,id=e9b57f91-ad8d-4146-a6e4-9138309aa071,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b57f91-ad') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'pci_devices' on Instance uuid 38e29c83-3067-492a-9b4c-953f5344ba2a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:40:53 user nova-compute[70374]:   <uuid>38e29c83-3067-492a-9b4c-953f5344ba2a</uuid>
Jul 27 09:40:53 user nova-compute[70374]:   <name>instance-0000001c</name>
Jul 27 09:40:53 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:40:53 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:40:53 user nova-compute[70374]:   <metadata>
Jul 27 09:40:53 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:40:53 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:40:53 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeNegativeTest-server-54880262</nova:name>
Jul 27 09:40:53 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:40:53</nova:creationTime>
Jul 27 09:40:53 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:40:53 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:40:53 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:40:53 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:40:53 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:40:53 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:40:53 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:40:53 user nova-compute[70374]:       <nova:owner>
Jul 27 09:40:53 user nova-compute[70374]:         <nova:user uuid="4c1d49c23b0045d881d9f47e33447162">tempest-AttachVolumeNegativeTest-305502590-project-member</nova:user>
Jul 27 09:40:53 user nova-compute[70374]:         <nova:project uuid="bfaa69b3745a435795aa636ccddec3af">tempest-AttachVolumeNegativeTest-305502590</nova:project>
Jul 27 09:40:53 user nova-compute[70374]:       </nova:owner>
Jul 27 09:40:53 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:40:53 user nova-compute[70374]:       <nova:ports>
Jul 27 09:40:53 user nova-compute[70374]:         <nova:port uuid="e9b57f91-ad8d-4146-a6e4-9138309aa071">
Jul 27 09:40:53 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 09:40:53 user nova-compute[70374]:         </nova:port>
Jul 27 09:40:53 user nova-compute[70374]:       </nova:ports>
Jul 27 09:40:53 user nova-compute[70374]:     </nova:instance>
Jul 27 09:40:53 user nova-compute[70374]:   </metadata>
Jul 27 09:40:53 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:40:53 user nova-compute[70374]:     <system>
Jul 27 09:40:53 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:40:53 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:40:53 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:40:53 user nova-compute[70374]:       <entry name="serial">38e29c83-3067-492a-9b4c-953f5344ba2a</entry>
Jul 27 09:40:53 user nova-compute[70374]:       <entry name="uuid">38e29c83-3067-492a-9b4c-953f5344ba2a</entry>
Jul 27 09:40:53 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:40:53 user nova-compute[70374]:     </system>
Jul 27 09:40:53 user nova-compute[70374]:   </sysinfo>
Jul 27 09:40:53 user nova-compute[70374]:   <os>
Jul 27 09:40:53 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:40:53 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:40:53 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:40:53 user nova-compute[70374]:   </os>
Jul 27 09:40:53 user nova-compute[70374]:   <features>
Jul 27 09:40:53 user nova-compute[70374]:     <acpi/>
Jul 27 09:40:53 user nova-compute[70374]:     <apic/>
Jul 27 09:40:53 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:40:53 user nova-compute[70374]:   </features>
Jul 27 09:40:53 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:40:53 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:40:53 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:40:53 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:40:53 user nova-compute[70374]:   </clock>
Jul 27 09:40:53 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:40:53 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:40:53 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:40:53 user nova-compute[70374]:   </cpu>
Jul 27 09:40:53 user nova-compute[70374]:   <devices>
Jul 27 09:40:53 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:40:53 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:40:53 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk"/>
Jul 27 09:40:53 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:40:53 user nova-compute[70374]:     </disk>
Jul 27 09:40:53 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:40:53 user nova-compute[70374]:       <mac address="fa:16:3e:bb:36:72"/>
Jul 27 09:40:53 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:40:53 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:40:53 user nova-compute[70374]:       <target dev="tape9b57f91-ad"/>
Jul 27 09:40:53 user nova-compute[70374]:     </interface>
Jul 27 09:40:53 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:40:53 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/console.log" append="off"/>
Jul 27 09:40:53 user nova-compute[70374]:     </serial>
Jul 27 09:40:53 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:40:53 user nova-compute[70374]:     <video>
Jul 27 09:40:53 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:40:53 user nova-compute[70374]:     </video>
Jul 27 09:40:53 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:40:53 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:40:53 user nova-compute[70374]:     </rng>
Jul 27 09:40:53 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:40:53 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:40:53 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:40:53 user nova-compute[70374]:     </memballoon>
Jul 27 09:40:53 user nova-compute[70374]:   </devices>
Jul 27 09:40:53 user nova-compute[70374]: </domain>
Jul 27 09:40:53 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-54880262',display_name='tempest-AttachVolumeNegativeTest-server-54880262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-54880262',id=28,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxydFxQntbmTuUdQYD1Xo27+bgVUXwgIBmPkoHTQLikz9TupV1eXN+VwwU1N9ducgIvEOTYpiao4N4Bhqbe6KM/p9HYZ+d2by0aWc2RUevQ77SF29HkGqN5t2FlJ0vsaw==',key_name='tempest-keypair-358103055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-ahqymeam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=38e29c83-3067-492a-9b4c-953f5344ba2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:36:72,bridge_name='br-int',has_traffic_filtering=True,id=e9b57f91-ad8d-4146-a6e4-9138309aa071,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b57f91-ad') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG os_vif [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:36:72,bridge_name='br-int',has_traffic_filtering=True,id=e9b57f91-ad8d-4146-a6e4-9138309aa071,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b57f91-ad') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b57f91-ad, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9b57f91-ad, col_values=(('external_ids', {'iface-id': 'e9b57f91-ad8d-4146-a6e4-9138309aa071', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:36:72', 'vm-uuid': '38e29c83-3067-492a-9b4c-953f5344ba2a'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:53 user nova-compute[70374]: INFO os_vif [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:36:72,bridge_name='br-int',has_traffic_filtering=True,id=e9b57f91-ad8d-4146-a6e4-9138309aa071,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b57f91-ad')
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No VIF found with MAC fa:16:3e:bb:36:72, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.network.neutron [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:40:53 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.policy [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d4c5ec795ee4d3387ce8718d2ac67e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0592f0be670742a181e24823955f378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:40:53 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Creating image(s)
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "/opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "/opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "/opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-d1e82441-042e-4536-9d2f-cd6a850f4130 req-90424fd6-d700-40de-96b6-391814921de7 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1e82441-042e-4536-9d2f-cd6a850f4130 req-90424fd6-d700-40de-96b6-391814921de7 service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1e82441-042e-4536-9d2f-cd6a850f4130 req-90424fd6-d700-40de-96b6-391814921de7 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1e82441-042e-4536-9d2f-cd6a850f4130 req-90424fd6-d700-40de-96b6-391814921de7 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-d1e82441-042e-4536-9d2f-cd6a850f4130 req-90424fd6-d700-40de-96b6-391814921de7 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:53 user nova-compute[70374]: WARNING nova.compute.manager [req-d1e82441-042e-4536-9d2f-cd6a850f4130 req-90424fd6-d700-40de-96b6-391814921de7 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state active and task_state rescuing.
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk 1073741824" returned: 0 in 0.060s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG nova.network.neutron [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Successfully created port: db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Cannot resize image /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'migration_context' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Ensure instance console log exists: /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.network.neutron [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Successfully updated port: db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-d2899b49-684e-452f-9a52-884e376ed516 req-24f55591-8dba-4c39-ad2b-5db62c3a063d service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-changed-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-d2899b49-684e-452f-9a52-884e376ed516 req-24f55591-8dba-4c39-ad2b-5db62c3a063d service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Refreshing instance network info cache due to event network-changed-db247eac-602c-4249-9473-94ee4a0dcfea. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d2899b49-684e-452f-9a52-884e376ed516 req-24f55591-8dba-4c39-ad2b-5db62c3a063d service nova] Acquiring lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d2899b49-684e-452f-9a52-884e376ed516 req-24f55591-8dba-4c39-ad2b-5db62c3a063d service nova] Acquired lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-d2899b49-684e-452f-9a52-884e376ed516 req-24f55591-8dba-4c39-ad2b-5db62c3a063d service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Refreshing network info cache for port db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-d2899b49-684e-452f-9a52-884e376ed516 req-24f55591-8dba-4c39-ad2b-5db62c3a063d service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.network.neutron [req-d2899b49-684e-452f-9a52-884e376ed516 req-24f55591-8dba-4c39-ad2b-5db62c3a063d service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d2899b49-684e-452f-9a52-884e376ed516 req-24f55591-8dba-4c39-ad2b-5db62c3a063d service nova] Releasing lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquired lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.network.neutron [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.network.neutron [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-f239ed17-d979-4381-82c6-016ff8525863 req-e2b45562-50fc-49d0-9806-be5aa47519da service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received event network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f239ed17-d979-4381-82c6-016ff8525863 req-e2b45562-50fc-49d0-9806-be5aa47519da service nova] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f239ed17-d979-4381-82c6-016ff8525863 req-e2b45562-50fc-49d0-9806-be5aa47519da service nova] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f239ed17-d979-4381-82c6-016ff8525863 req-e2b45562-50fc-49d0-9806-be5aa47519da service nova] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-f239ed17-d979-4381-82c6-016ff8525863 req-e2b45562-50fc-49d0-9806-be5aa47519da service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] No waiting events found dispatching network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:55 user nova-compute[70374]: WARNING nova.compute.manager [req-f239ed17-d979-4381-82c6-016ff8525863 req-e2b45562-50fc-49d0-9806-be5aa47519da service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received unexpected event network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 for instance with vm_state building and task_state spawning.
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.network.neutron [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Updating instance_info_cache with network_info: [{"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:55 user nova-compute[70374]: WARNING nova.compute.manager [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state active and task_state rescuing.
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:55 user nova-compute[70374]: WARNING nova.compute.manager [req-fbcf0f86-a50c-4b1a-89f8-fa83594027d1 req-1ca8ab6b-832a-4d01-bdfe-0926e3a5e977 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state active and task_state rescuing.
Jul 27 09:40:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Releasing lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Instance network_info: |[{"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:40:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Start _get_guest_xml network_info=[{"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:40:56 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:40:56 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-863353107',display_name='tempest-AttachVolumeTestJSON-server-863353107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-863353107',id=29,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIokJtVSvVLGcA2wpNLNfzVkxUnqdOhFZ2EgU8IKKAy7suSu5KP+LCEGnOEYnqO35QKNjdPDSdgYMN4onb1pLB3ww92gNiJEiYQF6vJ/uASdbo6Ns+VgQ8LJ3+HxD5uJTw==',key_name='tempest-keypair-2066385099',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-04fy0zqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=209af1ec-b5cb-491c-9854-8ff3a8b31b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=db247eac-602c-4249-9473-94ee4a0dcfea,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb247eac-60') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'pci_devices' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:40:56 user nova-compute[70374]:   <uuid>209af1ec-b5cb-491c-9854-8ff3a8b31b13</uuid>
Jul 27 09:40:56 user nova-compute[70374]:   <name>instance-0000001d</name>
Jul 27 09:40:56 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:40:56 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:40:56 user nova-compute[70374]:   <metadata>
Jul 27 09:40:56 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:40:56 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:40:56 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeTestJSON-server-863353107</nova:name>
Jul 27 09:40:56 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:40:56</nova:creationTime>
Jul 27 09:40:56 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:40:56 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:40:56 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:40:56 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:40:56 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:40:56 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:40:56 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:40:56 user nova-compute[70374]:       <nova:owner>
Jul 27 09:40:56 user nova-compute[70374]:         <nova:user uuid="9d4c5ec795ee4d3387ce8718d2ac67e0">tempest-AttachVolumeTestJSON-847846253-project-member</nova:user>
Jul 27 09:40:56 user nova-compute[70374]:         <nova:project uuid="0592f0be670742a181e24823955f378b">tempest-AttachVolumeTestJSON-847846253</nova:project>
Jul 27 09:40:56 user nova-compute[70374]:       </nova:owner>
Jul 27 09:40:56 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:40:56 user nova-compute[70374]:       <nova:ports>
Jul 27 09:40:56 user nova-compute[70374]:         <nova:port uuid="db247eac-602c-4249-9473-94ee4a0dcfea">
Jul 27 09:40:56 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 09:40:56 user nova-compute[70374]:         </nova:port>
Jul 27 09:40:56 user nova-compute[70374]:       </nova:ports>
Jul 27 09:40:56 user nova-compute[70374]:     </nova:instance>
Jul 27 09:40:56 user nova-compute[70374]:   </metadata>
Jul 27 09:40:56 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:40:56 user nova-compute[70374]:     <system>
Jul 27 09:40:56 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:40:56 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:40:56 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:40:56 user nova-compute[70374]:       <entry name="serial">209af1ec-b5cb-491c-9854-8ff3a8b31b13</entry>
Jul 27 09:40:56 user nova-compute[70374]:       <entry name="uuid">209af1ec-b5cb-491c-9854-8ff3a8b31b13</entry>
Jul 27 09:40:56 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:40:56 user nova-compute[70374]:     </system>
Jul 27 09:40:56 user nova-compute[70374]:   </sysinfo>
Jul 27 09:40:56 user nova-compute[70374]:   <os>
Jul 27 09:40:56 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:40:56 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:40:56 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:40:56 user nova-compute[70374]:   </os>
Jul 27 09:40:56 user nova-compute[70374]:   <features>
Jul 27 09:40:56 user nova-compute[70374]:     <acpi/>
Jul 27 09:40:56 user nova-compute[70374]:     <apic/>
Jul 27 09:40:56 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:40:56 user nova-compute[70374]:   </features>
Jul 27 09:40:56 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:40:56 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:40:56 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:40:56 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:40:56 user nova-compute[70374]:   </clock>
Jul 27 09:40:56 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:40:56 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:40:56 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:40:56 user nova-compute[70374]:   </cpu>
Jul 27 09:40:56 user nova-compute[70374]:   <devices>
Jul 27 09:40:56 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:40:56 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:40:56 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk"/>
Jul 27 09:40:56 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:40:56 user nova-compute[70374]:     </disk>
Jul 27 09:40:56 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:40:56 user nova-compute[70374]:       <mac address="fa:16:3e:6a:d7:9f"/>
Jul 27 09:40:56 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:40:56 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:40:56 user nova-compute[70374]:       <target dev="tapdb247eac-60"/>
Jul 27 09:40:56 user nova-compute[70374]:     </interface>
Jul 27 09:40:56 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:40:56 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/console.log" append="off"/>
Jul 27 09:40:56 user nova-compute[70374]:     </serial>
Jul 27 09:40:56 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:40:56 user nova-compute[70374]:     <video>
Jul 27 09:40:56 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:40:56 user nova-compute[70374]:     </video>
Jul 27 09:40:56 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:40:56 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:40:56 user nova-compute[70374]:     </rng>
Jul 27 09:40:56 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:40:56 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:40:56 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:40:56 user nova-compute[70374]:     </memballoon>
Jul 27 09:40:56 user nova-compute[70374]:   </devices>
Jul 27 09:40:56 user nova-compute[70374]: </domain>
Jul 27 09:40:56 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-863353107',display_name='tempest-AttachVolumeTestJSON-server-863353107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-863353107',id=29,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIokJtVSvVLGcA2wpNLNfzVkxUnqdOhFZ2EgU8IKKAy7suSu5KP+LCEGnOEYnqO35QKNjdPDSdgYMN4onb1pLB3ww92gNiJEiYQF6vJ/uASdbo6Ns+VgQ8LJ3+HxD5uJTw==',key_name='tempest-keypair-2066385099',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-04fy0zqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=209af1ec-b5cb-491c-9854-8ff3a8b31b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=db247eac-602c-4249-9473-94ee4a0dcfea,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb247eac-60') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG os_vif [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=db247eac-602c-4249-9473-94ee4a0dcfea,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb247eac-60') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb247eac-60, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb247eac-60, col_values=(('external_ids', {'iface-id': 'db247eac-602c-4249-9473-94ee4a0dcfea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:d7:9f', 'vm-uuid': '209af1ec-b5cb-491c-9854-8ff3a8b31b13'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:56 user nova-compute[70374]: INFO os_vif [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=db247eac-602c-4249-9473-94ee4a0dcfea,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb247eac-60')
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No VIF found with MAC fa:16:3e:6a:d7:9f, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-03fbfc91-53ce-49f4-a347-9c540fff5704 req-22a4d0ec-afca-43d2-bf1c-23110c869638 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-03fbfc91-53ce-49f4-a347-9c540fff5704 req-22a4d0ec-afca-43d2-bf1c-23110c869638 service nova] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-03fbfc91-53ce-49f4-a347-9c540fff5704 req-22a4d0ec-afca-43d2-bf1c-23110c869638 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-03fbfc91-53ce-49f4-a347-9c540fff5704 req-22a4d0ec-afca-43d2-bf1c-23110c869638 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-03fbfc91-53ce-49f4-a347-9c540fff5704 req-22a4d0ec-afca-43d2-bf1c-23110c869638 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] No waiting events found dispatching network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:57 user nova-compute[70374]: WARNING nova.compute.manager [req-03fbfc91-53ce-49f4-a347-9c540fff5704 req-22a4d0ec-afca-43d2-bf1c-23110c869638 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received unexpected event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea for instance with vm_state building and task_state spawning.
Jul 27 09:40:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-b6928d75-0602-4435-a120-d28f1d81e6f2 req-56693043-5a4d-485e-b1db-fd8606f62b58 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received event network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b6928d75-0602-4435-a120-d28f1d81e6f2 req-56693043-5a4d-485e-b1db-fd8606f62b58 service nova] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b6928d75-0602-4435-a120-d28f1d81e6f2 req-56693043-5a4d-485e-b1db-fd8606f62b58 service nova] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b6928d75-0602-4435-a120-d28f1d81e6f2 req-56693043-5a4d-485e-b1db-fd8606f62b58 service nova] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-b6928d75-0602-4435-a120-d28f1d81e6f2 req-56693043-5a4d-485e-b1db-fd8606f62b58 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] No waiting events found dispatching network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:57 user nova-compute[70374]: WARNING nova.compute.manager [req-b6928d75-0602-4435-a120-d28f1d81e6f2 req-56693043-5a4d-485e-b1db-fd8606f62b58 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received unexpected event network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 for instance with vm_state building and task_state spawning.
Jul 27 09:40:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MecVCLth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:40:58 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:40:58 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:40:58 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[100c97e8-ea61-4f82-a86c-971ab1ea1b97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:40:58 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abd3a38-775c-4de1-965a-6b032834da20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372] added
Jul 27 09:40:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca8af0-832c-4dd9-80be-30b27ba84257]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b33d80-74be-4344-9f4a-a235f2f314da]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MecVCLth {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MecVCLth" returned: 0 in 0.032s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9043c4-35bb-47bd-b679-146e74a28626]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MecVCLth'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39af1b7-2cc3-4a76-a7ae-f350dfdf4b1e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6bb1d5-a309-4e46-ae51-b3d67dfc5fb7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6de4c77-b04f-4151-95d6-128eb5918c49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372, portal: 172.16.0.220,3260]
Jul 27 09:40:58 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372, portal: 172.16.0.220,3260] successful.
Jul 27 09:40:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca19f0b9-7b78-450a-b832-12928c40905d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d794197f-95e6-490f-88cd-4d155fbc2475]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 (non-flash)
Jul 27 09:40:58 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[54783279-92ce-454a-b314-43996b05d46b]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MecVCLth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450859.055148, 38e29c83-3067-492a-9b4c-953f5344ba2a => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] VM Resumed (Lifecycle Event)
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Instance spawned successfully.
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450859.0566692, 38e29c83-3067-492a-9b4c-953f5344ba2a => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] VM Started (Lifecycle Event)
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Took 9.44 seconds to spawn the instance on the hypervisor.
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 66911d11-4025-4243-9f8e-ff0909460190 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450859.2024093, 66911d11-4025-4243-9f8e-ff0909460190 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] VM Resumed (Lifecycle Event)
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-56edf58d-60c2-44f4-bcb2-6cf5e18ae88b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450859.2036989, 66911d11-4025-4243-9f8e-ff0909460190 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] VM Started (Lifecycle Event)
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:40:59 user nova-compute[70374]: INFO nova.compute.manager [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Took 10.33 seconds to build instance.
Jul 27 09:40:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6ef33f2b-cc47-4945-8917-a41d7956338c tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.431s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26534346261636464', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534346261636464', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'flavor' on Instance uuid f6f417a6-c890-4372-8471-099eae592990 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:40:59 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:40:59 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:40:59 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:40:59 user nova-compute[70374]:   <serial>58667d65-004b-42f3-a627-9750c51ef372</serial>
Jul 27 09:40:59 user nova-compute[70374]: </disk>
Jul 27 09:40:59 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-11855370-76e3-4a32-b0aa-932400b2e1f8 req-c4f39f44-e150-4037-b09d-e43b05c5ef75 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-11855370-76e3-4a32-b0aa-932400b2e1f8 req-c4f39f44-e150-4037-b09d-e43b05c5ef75 service nova] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-11855370-76e3-4a32-b0aa-932400b2e1f8 req-c4f39f44-e150-4037-b09d-e43b05c5ef75 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-11855370-76e3-4a32-b0aa-932400b2e1f8 req-c4f39f44-e150-4037-b09d-e43b05c5ef75 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-11855370-76e3-4a32-b0aa-932400b2e1f8 req-c4f39f44-e150-4037-b09d-e43b05c5ef75 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] No waiting events found dispatching network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:40:59 user nova-compute[70374]: WARNING nova.compute.manager [req-11855370-76e3-4a32-b0aa-932400b2e1f8 req-c4f39f44-e150-4037-b09d-e43b05c5ef75 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received unexpected event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea for instance with vm_state building and task_state spawning.
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No VIF found with MAC fa:16:3e:b4:8b:03, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:40:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450860.018455, 209af1ec-b5cb-491c-9854-8ff3a8b31b13 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:41:00 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] VM Resumed (Lifecycle Event)
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:41:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Instance spawned successfully.
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:00 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450860.0187354, 209af1ec-b5cb-491c-9854-8ff3a8b31b13 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:41:00 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] VM Started (Lifecycle Event)
Jul 27 09:41:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6d214305-eaa3-41b0-bfff-ab6e9dd62b9f tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.384s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:41:00 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:41:00 user nova-compute[70374]: INFO nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Took 6.44 seconds to spawn the instance on the hypervisor.
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:00 user nova-compute[70374]: INFO nova.compute.manager [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Took 7.36 seconds to build instance.
Jul 27 09:41:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e56b3cdb-6004-44fa-b7e3-654831744d44 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.473s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 09:41:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 09:41:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:41:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:41:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:41:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:41:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:41:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:12 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:41:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:41:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:41:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:18 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:41:18 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7437MB free_disk=25.385196685791016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 69a59942-cd83-4f74-82ea-f23a6538cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 66911d11-4025-4243-9f8e-ff0909460190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance f6f417a6-c890-4372-8471-099eae592990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 38e29c83-3067-492a-9b4c-953f5344ba2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.738s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:41:18 user nova-compute[70374]: INFO nova.compute.claims [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Claim successful on node user
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:41:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.policy [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '377915ad2c6e4244b5bd1a7ed97c6afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d32e43d96bc4f0a99fd3378c1677fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:41:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Creating image(s)
Jul 27 09:41:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.159s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk 1073741824" returned: 0 in 0.062s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG nova.network.neutron [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Successfully created port: dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Cannot resize image /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'migration_context' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Ensure instance console log exists: /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Successfully updated port: dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquired lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-62428e1f-e375-43e5-9ede-fe0acb8495e4 req-cec69a2a-839b-4ca9-b2b3-2cc05bcf3982 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-changed-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-62428e1f-e375-43e5-9ede-fe0acb8495e4 req-cec69a2a-839b-4ca9-b2b3-2cc05bcf3982 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Refreshing instance network info cache due to event network-changed-dfa2198f-6276-43cd-8b58-8281d4424143. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-62428e1f-e375-43e5-9ede-fe0acb8495e4 req-cec69a2a-839b-4ca9-b2b3-2cc05bcf3982 service nova] Acquiring lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating instance_info_cache with network_info: [{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Releasing lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance network_info: |[{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-62428e1f-e375-43e5-9ede-fe0acb8495e4 req-cec69a2a-839b-4ca9-b2b3-2cc05bcf3982 service nova] Acquired lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.neutron [req-62428e1f-e375-43e5-9ede-fe0acb8495e4 req-cec69a2a-839b-4ca9-b2b3-2cc05bcf3982 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Refreshing network info cache for port dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Start _get_guest_xml network_info=[{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:41:21 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:41:21 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038229673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1038229673',id=30,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOggog+sD4MFx0TWo+CfaL3x6gHI0VGarfQSfGQ3rWq08Yysx0zbtwW7ER+CAZlTK2NE1UVnxPc+lt5QyNYC4qOg/idV3sz+RgkLh8GySrbyoOyjcG2gias3K2Jazhaw+w==',key_name='tempest-keypair-1092477681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-1ws0fl1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=56ab07d0-823d-4282-bdc5-21910c33678a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'pci_devices' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:41:21 user nova-compute[70374]:   <uuid>56ab07d0-823d-4282-bdc5-21910c33678a</uuid>
Jul 27 09:41:21 user nova-compute[70374]:   <name>instance-0000001e</name>
Jul 27 09:41:21 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:41:21 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:41:21 user nova-compute[70374]:   <metadata>
Jul 27 09:41:21 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:41:21 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:41:21 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1038229673</nova:name>
Jul 27 09:41:21 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:41:21</nova:creationTime>
Jul 27 09:41:21 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:41:21 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:41:21 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:41:21 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:41:21 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:41:21 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:41:21 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:41:21 user nova-compute[70374]:       <nova:owner>
Jul 27 09:41:21 user nova-compute[70374]:         <nova:user uuid="377915ad2c6e4244b5bd1a7ed97c6afb">tempest-AttachVolumeShelveTestJSON-1605888290-project-member</nova:user>
Jul 27 09:41:21 user nova-compute[70374]:         <nova:project uuid="5d32e43d96bc4f0a99fd3378c1677fb7">tempest-AttachVolumeShelveTestJSON-1605888290</nova:project>
Jul 27 09:41:21 user nova-compute[70374]:       </nova:owner>
Jul 27 09:41:21 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:41:21 user nova-compute[70374]:       <nova:ports>
Jul 27 09:41:21 user nova-compute[70374]:         <nova:port uuid="dfa2198f-6276-43cd-8b58-8281d4424143">
Jul 27 09:41:21 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 09:41:21 user nova-compute[70374]:         </nova:port>
Jul 27 09:41:21 user nova-compute[70374]:       </nova:ports>
Jul 27 09:41:21 user nova-compute[70374]:     </nova:instance>
Jul 27 09:41:21 user nova-compute[70374]:   </metadata>
Jul 27 09:41:21 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:41:21 user nova-compute[70374]:     <system>
Jul 27 09:41:21 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:41:21 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:41:21 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:41:21 user nova-compute[70374]:       <entry name="serial">56ab07d0-823d-4282-bdc5-21910c33678a</entry>
Jul 27 09:41:21 user nova-compute[70374]:       <entry name="uuid">56ab07d0-823d-4282-bdc5-21910c33678a</entry>
Jul 27 09:41:21 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:41:21 user nova-compute[70374]:     </system>
Jul 27 09:41:21 user nova-compute[70374]:   </sysinfo>
Jul 27 09:41:21 user nova-compute[70374]:   <os>
Jul 27 09:41:21 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:41:21 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:41:21 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:41:21 user nova-compute[70374]:   </os>
Jul 27 09:41:21 user nova-compute[70374]:   <features>
Jul 27 09:41:21 user nova-compute[70374]:     <acpi/>
Jul 27 09:41:21 user nova-compute[70374]:     <apic/>
Jul 27 09:41:21 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:41:21 user nova-compute[70374]:   </features>
Jul 27 09:41:21 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:41:21 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:41:21 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:41:21 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:41:21 user nova-compute[70374]:   </clock>
Jul 27 09:41:21 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:41:21 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:41:21 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:41:21 user nova-compute[70374]:   </cpu>
Jul 27 09:41:21 user nova-compute[70374]:   <devices>
Jul 27 09:41:21 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:41:21 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:41:21 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk"/>
Jul 27 09:41:21 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:41:21 user nova-compute[70374]:     </disk>
Jul 27 09:41:21 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:41:21 user nova-compute[70374]:       <mac address="fa:16:3e:e9:1f:ee"/>
Jul 27 09:41:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:41:21 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:41:21 user nova-compute[70374]:       <target dev="tapdfa2198f-62"/>
Jul 27 09:41:21 user nova-compute[70374]:     </interface>
Jul 27 09:41:21 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:41:21 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/console.log" append="off"/>
Jul 27 09:41:21 user nova-compute[70374]:     </serial>
Jul 27 09:41:21 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:41:21 user nova-compute[70374]:     <video>
Jul 27 09:41:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:41:21 user nova-compute[70374]:     </video>
Jul 27 09:41:21 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:41:21 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:41:21 user nova-compute[70374]:     </rng>
Jul 27 09:41:21 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:41:21 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:41:21 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:41:21 user nova-compute[70374]:     </memballoon>
Jul 27 09:41:21 user nova-compute[70374]:   </devices>
Jul 27 09:41:21 user nova-compute[70374]: </domain>
Jul 27 09:41:21 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038229673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1038229673',id=30,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOggog+sD4MFx0TWo+CfaL3x6gHI0VGarfQSfGQ3rWq08Yysx0zbtwW7ER+CAZlTK2NE1UVnxPc+lt5QyNYC4qOg/idV3sz+RgkLh8GySrbyoOyjcG2gias3K2Jazhaw+w==',key_name='tempest-keypair-1092477681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-1ws0fl1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=56ab07d0-823d-4282-bdc5-21910c33678a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG os_vif [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfa2198f-62, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfa2198f-62, col_values=(('external_ids', {'iface-id': 'dfa2198f-6276-43cd-8b58-8281d4424143', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:1f:ee', 'vm-uuid': '56ab07d0-823d-4282-bdc5-21910c33678a'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:21 user nova-compute[70374]: INFO os_vif [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62')
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:41:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No VIF found with MAC fa:16:3e:e9:1f:ee, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:41:22 user nova-compute[70374]: DEBUG nova.network.neutron [req-62428e1f-e375-43e5-9ede-fe0acb8495e4 req-cec69a2a-839b-4ca9-b2b3-2cc05bcf3982 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updated VIF entry in instance network info cache for port dfa2198f-6276-43cd-8b58-8281d4424143. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:41:22 user nova-compute[70374]: DEBUG nova.network.neutron [req-62428e1f-e375-43e5-9ede-fe0acb8495e4 req-cec69a2a-839b-4ca9-b2b3-2cc05bcf3982 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating instance_info_cache with network_info: [{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:41:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-62428e1f-e375-43e5-9ede-fe0acb8495e4 req-cec69a2a-839b-4ca9-b2b3-2cc05bcf3982 service nova] Releasing lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:41:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-15e03de0-0e8a-4157-ba52-d94825e9f6f6 req-c4d057a3-4325-4a86-8c43-ba322033cdb9 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-15e03de0-0e8a-4157-ba52-d94825e9f6f6 req-c4d057a3-4325-4a86-8c43-ba322033cdb9 service nova] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-15e03de0-0e8a-4157-ba52-d94825e9f6f6 req-c4d057a3-4325-4a86-8c43-ba322033cdb9 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-15e03de0-0e8a-4157-ba52-d94825e9f6f6 req-c4d057a3-4325-4a86-8c43-ba322033cdb9 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-15e03de0-0e8a-4157-ba52-d94825e9f6f6 req-c4d057a3-4325-4a86-8c43-ba322033cdb9 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] No waiting events found dispatching network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:23 user nova-compute[70374]: WARNING nova.compute.manager [req-15e03de0-0e8a-4157-ba52-d94825e9f6f6 req-c4d057a3-4325-4a86-8c43-ba322033cdb9 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received unexpected event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 for instance with vm_state building and task_state spawning.
Jul 27 09:41:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450885.4365263, 56ab07d0-823d-4282-bdc5-21910c33678a => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:41:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] VM Resumed (Lifecycle Event)
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:41:25 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance spawned successfully.
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:41:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450885.4380472, 56ab07d0-823d-4282-bdc5-21910c33678a => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:41:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] VM Started (Lifecycle Event)
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-5677dc37-73e6-49a0-a20c-b09f21066f82 req-d14c3ca0-7dd6-408d-9473-1697f3fdfa44 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5677dc37-73e6-49a0-a20c-b09f21066f82 req-d14c3ca0-7dd6-408d-9473-1697f3fdfa44 service nova] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5677dc37-73e6-49a0-a20c-b09f21066f82 req-d14c3ca0-7dd6-408d-9473-1697f3fdfa44 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5677dc37-73e6-49a0-a20c-b09f21066f82 req-d14c3ca0-7dd6-408d-9473-1697f3fdfa44 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-5677dc37-73e6-49a0-a20c-b09f21066f82 req-d14c3ca0-7dd6-408d-9473-1697f3fdfa44 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] No waiting events found dispatching network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:25 user nova-compute[70374]: WARNING nova.compute.manager [req-5677dc37-73e6-49a0-a20c-b09f21066f82 req-d14c3ca0-7dd6-408d-9473-1697f3fdfa44 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received unexpected event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 for instance with vm_state building and task_state spawning.
Jul 27 09:41:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:41:25 user nova-compute[70374]: INFO nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Took 5.64 seconds to spawn the instance on the hypervisor.
Jul 27 09:41:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:25 user nova-compute[70374]: INFO nova.compute.manager [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Took 6.84 seconds to build instance.
Jul 27 09:41:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-90e1750d-c04d-4803-96ce-0bcbfbb5d0c2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.937s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:30 user nova-compute[70374]: INFO nova.compute.manager [None req-8beac13d-4c71-4769-b547-4a4a62bd4557 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Unrescuing
Jul 27 09:41:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8beac13d-4c71-4769-b547-4a4a62bd4557 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:41:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8beac13d-4c71-4769-b547-4a4a62bd4557 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquired lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:41:30 user nova-compute[70374]: DEBUG nova.network.neutron [None req-8beac13d-4c71-4769-b547-4a4a62bd4557 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:31 user nova-compute[70374]: INFO nova.compute.manager [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Detaching volume 58667d65-004b-42f3-a627-9750c51ef372
Jul 27 09:41:31 user nova-compute[70374]: INFO nova.virt.block_device [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Attempting to driver detach volume 58667d65-004b-42f3-a627-9750c51ef372 from mountpoint /dev/vdb
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-8beac13d-4c71-4769-b547-4a4a62bd4557 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Attempting to detach device vdb from instance f6f417a6-c890-4372-8471-099eae592990 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:41:31 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:41:31 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:41:31 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:41:31 user nova-compute[70374]:   <serial>58667d65-004b-42f3-a627-9750c51ef372</serial>
Jul 27 09:41:31 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:41:31 user nova-compute[70374]: </disk>
Jul 27 09:41:31 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:41:31 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Successfully detached device vdb from instance f6f417a6-c890-4372-8471-099eae592990 from the persistent domain config.
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6f417a6-c890-4372-8471-099eae592990 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:41:31 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:41:31 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:41:31 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:41:31 user nova-compute[70374]:   <serial>58667d65-004b-42f3-a627-9750c51ef372</serial>
Jul 27 09:41:31 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:41:31 user nova-compute[70374]: </disk>
Jul 27 09:41:31 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8beac13d-4c71-4769-b547-4a4a62bd4557 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Releasing lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8beac13d-4c71-4769-b547-4a4a62bd4557 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'flavor' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-d822c10e-17c0-47e3-b650-722402135a92 req-73937a2c-c193-46e9-861d-455f72389bbf service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d822c10e-17c0-47e3-b650-722402135a92 req-73937a2c-c193-46e9-861d-455f72389bbf service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d822c10e-17c0-47e3-b650-722402135a92 req-73937a2c-c193-46e9-861d-455f72389bbf service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d822c10e-17c0-47e3-b650-722402135a92 req-73937a2c-c193-46e9-861d-455f72389bbf service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-d822c10e-17c0-47e3-b650-722402135a92 req-73937a2c-c193-46e9-861d-455f72389bbf service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:31 user nova-compute[70374]: WARNING nova.compute.manager [req-d822c10e-17c0-47e3-b650-722402135a92 req-73937a2c-c193-46e9-861d-455f72389bbf service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450891.9511344, f6f417a6-c890-4372-8471-099eae592990 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6f417a6-c890-4372-8471-099eae592990 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:41:31 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Successfully detached device vdb from instance f6f417a6-c890-4372-8471-099eae592990 from the live domain config.
Jul 27 09:41:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MecVCLth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:41:31 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:41:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:41:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3fe3de-c2e6-4b02-b8ce-a8808e586b4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:41:32 user nova-compute[70374]: No targets found.
Jul 27 09:41:32 user nova-compute[70374]: iSNS:
Jul 27 09:41:32 user nova-compute[70374]: No targets found.
Jul 27 09:41:32 user nova-compute[70374]: STATIC:
Jul 27 09:41:32 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc
Jul 27 09:41:32 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:32 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:32 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372
Jul 27 09:41:32 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:32 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:32 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:41:32 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:32 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:32 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:41:32 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:32 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:32 user nova-compute[70374]: FIRMWARE:
Jul 27 09:41:32 user nova-compute[70374]: No targets found.
Jul 27 09:41:32 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:41:32 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:41:32 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6a7f1b-1821-4540-9aa1-d3918276f579]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e88e11-4188-477f-a3ff-282085b13428]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:32 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:32 user nova-compute[70374]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 (non-flash)
Jul 27 09:41:32 user nova-compute[70374]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)
Jul 27 09:41:32 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:32 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:32 user nova-compute[70374]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 (non-flash)
Jul 27 09:41:32 user nova-compute[70374]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)
Jul 27 09:41:32 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc4339a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-142b53dc-f020-422c-9206-a8a9bc97112f req-699a74bd-1ef3-4ca5-94e2-51f81f13c128 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-changed-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-142b53dc-f020-422c-9206-a8a9bc97112f req-699a74bd-1ef3-4ca5-94e2-51f81f13c128 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Refreshing instance network info cache due to event network-changed-08a126de-9aff-4def-baa5-0401181a8d3b. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-142b53dc-f020-422c-9206-a8a9bc97112f req-699a74bd-1ef3-4ca5-94e2-51f81f13c128 service nova] Acquiring lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-142b53dc-f020-422c-9206-a8a9bc97112f req-699a74bd-1ef3-4ca5-94e2-51f81f13c128 service nova] Acquired lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-142b53dc-f020-422c-9206-a8a9bc97112f req-699a74bd-1ef3-4ca5-94e2-51f81f13c128 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Refreshing network info cache for port 08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[42775de8-fd4a-4d92-b5d8-6f4cd0535d56]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac74b1-fa6f-4052-9292-2955aa551952]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa17f53-ba37-4399-aaf4-99d431342655]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec100f6-e33b-4ebb-9f0d-d5b355cd94e5]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a4021a-e18b-4133-83b0-24380e6099cc]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ca0d8f-6fa1-493d-a67d-81aa581b0862]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372, portal: 172.16.0.220,3260]
Jul 27 09:41:32 user nova-compute[70374]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372, portal: 172.16.0.220,3260] successful.
Jul 27 09:41:32 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[63992224-196e-423d-a7a0-92a8184dde93]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] <== disconnect_volume: return (421ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:41:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance destroyed successfully.
Jul 27 09:41:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-142b53dc-f020-422c-9206-a8a9bc97112f req-699a74bd-1ef3-4ca5-94e2-51f81f13c128 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updated VIF entry in instance network info cache for port 08a126de-9aff-4def-baa5-0401181a8d3b. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-142b53dc-f020-422c-9206-a8a9bc97112f req-699a74bd-1ef3-4ca5-94e2-51f81f13c128 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:41:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-142b53dc-f020-422c-9206-a8a9bc97112f req-699a74bd-1ef3-4ca5-94e2-51f81f13c128 service nova] Releasing lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'flavor' on Instance uuid f6f417a6-c890-4372-8471-099eae592990 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0d4045d1-0f2c-487e-91f2-bb19a8d75817 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.204s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.041s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:33 user nova-compute[70374]: INFO nova.compute.manager [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Terminating instance
Jul 27 09:41:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-eb227ce8-dc93-4646-b112-d624731e718e req-99a6c732-ffb0-4c51-ad61-8862e1340ad6 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eb227ce8-dc93-4646-b112-d624731e718e req-99a6c732-ffb0-4c51-ad61-8862e1340ad6 service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eb227ce8-dc93-4646-b112-d624731e718e req-99a6c732-ffb0-4c51-ad61-8862e1340ad6 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-eb227ce8-dc93-4646-b112-d624731e718e req-99a6c732-ffb0-4c51-ad61-8862e1340ad6 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-eb227ce8-dc93-4646-b112-d624731e718e req-99a6c732-ffb0-4c51-ad61-8862e1340ad6 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:33 user nova-compute[70374]: WARNING nova.compute.manager [req-eb227ce8-dc93-4646-b112-d624731e718e req-99a6c732-ffb0-4c51-ad61-8862e1340ad6 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'flavor' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:34 user nova-compute[70374]: INFO nova.compute.manager [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Attaching volume d85fc96b-076c-4399-a10f-a6468bb76248 to /dev/vdb
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.utils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-changed-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Refreshing instance network info cache due to event network-changed-08a126de-9aff-4def-baa5-0401181a8d3b. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] Acquiring lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] Acquired lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Refreshing network info cache for port 08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9127ce6f-715f-499d-bc29-57130b8f4589]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c2f3c-2201-4309-b836-288371790d28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[15af80bc-a3b5-47bb-ae40-31ca4b0a1536]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4cbdfe-3138-4108-99e7-4745eae12e55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:41:34 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8586a817-a3d6-4ab4-9b71-eb783bd1616d]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.utils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating existing volume attachment record: 9c99cf1c-f7af-4162-b7e5-da40ce1aadb8 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:34 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: f6f417a6-c890-4372-8471-099eae592990] Instance destroyed successfully.
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'resources' on Instance uuid f6f417a6-c890-4372-8471-099eae592990 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-305128003',display_name='tempest-VolumesSnapshotTestJSON-instance-305128003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-305128003',id=27,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhQH7addfP25IS1QNc4r1AsJMN7674fbEC5suVcgz4lfyY0/KBJ9bTky5LV1V21zwwwOn6IGaJMIcqxx4QCgrdWbDoOHz/sLhw15ZlFiZlfAtK9Xq9vLoKG7kd0+8JXdg==',key_name='tempest-keypair-167604713',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d47c627f4a94472a80b922a262aa172',ramdisk_id='',reservation_id='r-1h0g5urz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1299698694',owner_user_name='tempest-VolumesSnapshotTestJSON-1299698694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:39:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8d942c3b93453bafa8381f39ec85a9',uuid=f6f417a6-c890-4372-8471-099eae592990,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converting VIF {"id": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "address": "fa:16:3e:b4:8b:03", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30631f7-42", "ovs_interfaceid": "c30631f7-4236-40e8-8c15-15a6a1d94eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=c30631f7-4236-40e8-8c15-15a6a1d94eaa,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc30631f7-42') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_vif [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=c30631f7-4236-40e8-8c15-15a6a1d94eaa,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc30631f7-42') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc30631f7-42, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:34 user nova-compute[70374]: INFO os_vif [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=c30631f7-4236-40e8-8c15-15a6a1d94eaa,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc30631f7-42')
Jul 27 09:41:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MecVCLth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:41:34 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[293efedb-59cb-4532-8145-885025958e21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:41:34 user nova-compute[70374]: No targets found.
Jul 27 09:41:34 user nova-compute[70374]: iSNS:
Jul 27 09:41:34 user nova-compute[70374]: No targets found.
Jul 27 09:41:34 user nova-compute[70374]: STATIC:
Jul 27 09:41:34 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc
Jul 27 09:41:34 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:34 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:34 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:41:34 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:34 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:34 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:41:34 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:34 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:34 user nova-compute[70374]: FIRMWARE:
Jul 27 09:41:34 user nova-compute[70374]: No targets found.
Jul 27 09:41:34 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:41:35 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:41:35 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58667d65-004b-42f3-a627-9750c51ef372', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[149340e6-995b-472a-8bfd-207b4e10fb02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a7a7c6-afd3-4d3f-994c-a4fbb7928aeb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:35 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:35 user nova-compute[70374]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)
Jul 27 09:41:35 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:35 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:35 user nova-compute[70374]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)
Jul 27 09:41:35 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc432440>, {}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Disconnecting from: [] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.109s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] <== disconnect_volume: return (110ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:41:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Deleting instance files /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990_del
Jul 27 09:41:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Deletion of /opt/stack/data/nova/instances/f6f417a6-c890-4372-8471-099eae592990_del complete
Jul 27 09:41:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updated VIF entry in instance network info cache for port 08a126de-9aff-4def-baa5-0401181a8d3b. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [{"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:41:35 user nova-compute[70374]: INFO nova.compute.manager [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Took 2.50 seconds to destroy the instance on the hypervisor.
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: f6f417a6-c890-4372-8471-099eae592990] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: f6f417a6-c890-4372-8471-099eae592990] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] Releasing lock "refresh_cache-69a59942-cd83-4f74-82ea-f23a6538cef9" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received event network-vif-unplugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] Lock "f6f417a6-c890-4372-8471-099eae592990-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] Lock "f6f417a6-c890-4372-8471-099eae592990-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] No waiting events found dispatching network-vif-unplugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-1f8925aa-4751-4b34-a2e4-6a0ce83e7203 req-003b2252-8120-4907-ba8d-1751c711bf4a service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received event network-vif-unplugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-3e3c05ed-f34e-4f95-b177-974760835e6b req-80e96612-16c5-45a6-bd95-7ff0264456f0 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3e3c05ed-f34e-4f95-b177-974760835e6b req-80e96612-16c5-45a6-bd95-7ff0264456f0 service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3e3c05ed-f34e-4f95-b177-974760835e6b req-80e96612-16c5-45a6-bd95-7ff0264456f0 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3e3c05ed-f34e-4f95-b177-974760835e6b req-80e96612-16c5-45a6-bd95-7ff0264456f0 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-3e3c05ed-f34e-4f95-b177-974760835e6b req-80e96612-16c5-45a6-bd95-7ff0264456f0 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:36 user nova-compute[70374]: WARNING nova.compute.manager [req-3e3c05ed-f34e-4f95-b177-974760835e6b req-80e96612-16c5-45a6-bd95-7ff0264456f0 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:41:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-0f778d59-7a87-465e-b82e-9de501fe5c5c req-c95b3721-fcb4-4d83-b94e-597137965043 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received event network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0f778d59-7a87-465e-b82e-9de501fe5c5c req-c95b3721-fcb4-4d83-b94e-597137965043 service nova] Acquiring lock "f6f417a6-c890-4372-8471-099eae592990-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0f778d59-7a87-465e-b82e-9de501fe5c5c req-c95b3721-fcb4-4d83-b94e-597137965043 service nova] Lock "f6f417a6-c890-4372-8471-099eae592990-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0f778d59-7a87-465e-b82e-9de501fe5c5c req-c95b3721-fcb4-4d83-b94e-597137965043 service nova] Lock "f6f417a6-c890-4372-8471-099eae592990-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-0f778d59-7a87-465e-b82e-9de501fe5c5c req-c95b3721-fcb4-4d83-b94e-597137965043 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] No waiting events found dispatching network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:36 user nova-compute[70374]: WARNING nova.compute.manager [req-0f778d59-7a87-465e-b82e-9de501fe5c5c req-c95b3721-fcb4-4d83-b94e-597137965043 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received unexpected event network-vif-plugged-c30631f7-4236-40e8-8c15-15a6a1d94eaa for instance with vm_state active and task_state deleting.
Jul 27 09:41:38 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: f6f417a6-c890-4372-8471-099eae592990] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:41:38 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: f6f417a6-c890-4372-8471-099eae592990] Took 2.27 seconds to deallocate network for instance.
Jul 27 09:41:38 user nova-compute[70374]: WARNING nova.volume.cinder [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Attachment 4eceeb9c-55aa-449b-aac0-60e706a5808f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4eceeb9c-55aa-449b-aac0-60e706a5808f. (HTTP 404) (Request-ID: req-06d709a6-ede3-44ee-b207-8ed8e6ca97a9)
Jul 27 09:41:38 user nova-compute[70374]: INFO nova.compute.manager [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: f6f417a6-c890-4372-8471-099eae592990] Took 0.05 seconds to detach 1 volumes for instance.
Jul 27 09:41:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-136ce516-729b-487a-aa9f-ec52ed4bbb53 req-43e04b2e-ed12-41af-a47b-2cb618c78ba7 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-136ce516-729b-487a-aa9f-ec52ed4bbb53 req-43e04b2e-ed12-41af-a47b-2cb618c78ba7 service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-136ce516-729b-487a-aa9f-ec52ed4bbb53 req-43e04b2e-ed12-41af-a47b-2cb618c78ba7 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-136ce516-729b-487a-aa9f-ec52ed4bbb53 req-43e04b2e-ed12-41af-a47b-2cb618c78ba7 service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-136ce516-729b-487a-aa9f-ec52ed4bbb53 req-43e04b2e-ed12-41af-a47b-2cb618c78ba7 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:38 user nova-compute[70374]: WARNING nova.compute.manager [req-136ce516-729b-487a-aa9f-ec52ed4bbb53 req-43e04b2e-ed12-41af-a47b-2cb618c78ba7 service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:41:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-136ce516-729b-487a-aa9f-ec52ed4bbb53 req-43e04b2e-ed12-41af-a47b-2cb618c78ba7 service nova] [instance: f6f417a6-c890-4372-8471-099eae592990] Received event network-vif-deleted-c30631f7-4236-40e8-8c15-15a6a1d94eaa {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:38 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:41:38 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:41:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.623s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:39 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Deleted allocations for instance f6f417a6-c890-4372-8471-099eae592990
Jul 27 09:41:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca3ccd2a-6ef4-42a2-8694-c7102aabe89d tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "f6f417a6-c890-4372-8471-099eae592990" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.820s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 69a59942-cd83-4f74-82ea-f23a6538cef9 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:41:39 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450899.6809356, 69a59942-cd83-4f74-82ea-f23a6538cef9 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:41:39 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] VM Resumed (Lifecycle Event)
Jul 27 09:41:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8beac13d-4c71-4769-b547-4a4a62bd4557 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:41:39 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 09:41:39 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450899.6839323, 69a59942-cd83-4f74-82ea-f23a6538cef9 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:41:39 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] VM Started (Lifecycle Event)
Jul 27 09:41:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:41:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrDofsOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:41:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:41:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:41:43 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99a88bc-19f0-4981-9928-6adc9a3aef54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:41:43 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bfe913-9a19-430f-9690-c516e90e827d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248] added
Jul 27 09:41:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c620d2-8dad-41ae-9c5f-6708135b4499]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d162e6b3-f07f-4e86-9bf1-d6eda4214308]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrDofsOF {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrDofsOF" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac93346e-0f2b-4239-b082-4d9884a001c6]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xrDofsOF'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[329421af-0a96-4fe3-8e65-b98a78f51068]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc418a69-6499-4b0e-ae47-31a51292490a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:43 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:43 user nova-compute[70374]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)
Jul 27 09:41:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:43 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:43 user nova-compute[70374]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)
Jul 27 09:41:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:41:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6057a3-196c-499f-b3e8-dce08da1c8dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260]
Jul 27 09:41:44 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260] successful.
Jul 27 09:41:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3427deb-39be-4a76-aa1a-88d7e0b718a0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5be1ab-49b8-4816-aedf-b4292e648d9a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:44 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:44 user nova-compute[70374]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)
Jul 27 09:41:44 user nova-compute[70374]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:41:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:44 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:44 user nova-compute[70374]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dbf1c6-903a-4fee-a2d9-f67089058adc (non-flash)
Jul 27 09:41:44 user nova-compute[70374]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:41:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafcea22-9e01-4318-8abc-9c59cece710f]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrDofsOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:41:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23765323638613635', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:41:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765323638613635', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:41:45 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'flavor' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:41:45 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:41:45 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:41:45 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:41:45 user nova-compute[70374]:   <serial>d85fc96b-076c-4399-a10f-a6468bb76248</serial>
Jul 27 09:41:45 user nova-compute[70374]: </disk>
Jul 27 09:41:45 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:41:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:41:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:41:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No VIF found with MAC fa:16:3e:8f:9b:7f, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:41:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1b91a80a-73ae-49aa-a508-2aecebe0082b tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.940s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:49 user nova-compute[70374]: INFO nova.compute.manager [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Rebuilding instance
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'trusted_certs' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'pci_requests' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'pci_devices' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'resources' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'migration_context' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70374) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-5638fbbb-290b-4d2b-a1d0-3032c0e77367 req-557f93eb-9628-4ecd-8aa7-ab852e68ee00 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-unplugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5638fbbb-290b-4d2b-a1d0-3032c0e77367 req-557f93eb-9628-4ecd-8aa7-ab852e68ee00 service nova] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5638fbbb-290b-4d2b-a1d0-3032c0e77367 req-557f93eb-9628-4ecd-8aa7-ab852e68ee00 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5638fbbb-290b-4d2b-a1d0-3032c0e77367 req-557f93eb-9628-4ecd-8aa7-ab852e68ee00 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-5638fbbb-290b-4d2b-a1d0-3032c0e77367 req-557f93eb-9628-4ecd-8aa7-ab852e68ee00 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] No waiting events found dispatching network-vif-unplugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:49 user nova-compute[70374]: WARNING nova.compute.manager [req-5638fbbb-290b-4d2b-a1d0-3032c0e77367 req-557f93eb-9628-4ecd-8aa7-ab852e68ee00 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received unexpected event network-vif-unplugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a for instance with vm_state active and task_state rebuilding.
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450894.8168533, f6f417a6-c890-4372-8471-099eae592990 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:41:49 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: f6f417a6-c890-4372-8471-099eae592990] VM Stopped (Lifecycle Event)
Jul 27 09:41:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9ff2091f-8418-4407-9770-b238933bb084 None None] [instance: f6f417a6-c890-4372-8471-099eae592990] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:50 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance destroyed successfully.
Jul 27 09:41:50 user nova-compute[70374]: INFO nova.compute.manager [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Detaching volume d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:41:50 user nova-compute[70374]: INFO nova.virt.block_device [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Attempting to driver detach volume d85fc96b-076c-4399-a10f-a6468bb76248 from mountpoint /dev/vdb
Jul 27 09:41:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Attempting to detach device vdb from instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:41:50 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:41:50 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:41:50 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:41:50 user nova-compute[70374]:   <serial>d85fc96b-076c-4399-a10f-a6468bb76248</serial>
Jul 27 09:41:50 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:41:50 user nova-compute[70374]: </disk>
Jul 27 09:41:50 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:41:50 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully detached device vdb from instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 from the persistent domain config.
Jul 27 09:41:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrDofsOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:41:50 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8117e1b7-77cc-4827-955a-6f06e5211abd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:41:50 user nova-compute[70374]: No targets found.
Jul 27 09:41:50 user nova-compute[70374]: iSNS:
Jul 27 09:41:50 user nova-compute[70374]: No targets found.
Jul 27 09:41:50 user nova-compute[70374]: STATIC:
Jul 27 09:41:50 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:41:50 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:50 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:50 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:41:50 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:50 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:50 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:41:50 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:50 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:50 user nova-compute[70374]: FIRMWARE:
Jul 27 09:41:50 user nova-compute[70374]: No targets found.
Jul 27 09:41:50 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:41:50 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:41:50 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f967ca-3826-436d-8638-b96d995d36d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73a56c-d62b-4c4f-b0d0-81739d8321a9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:50 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:50 user nova-compute[70374]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:41:50 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:50 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:50 user nova-compute[70374]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:41:50 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5d5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5073206-890c-4bed-8c6f-e726b5c30bd9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4305e1-581a-4d61-9382-67c6190b7630]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891e857-9641-4c48-9237-0c438b76889a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[229f8ce4-4c44-4a65-b573-39249a864fce]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa97cdb-12c6-41a2-9b52-7c8ac0a74069]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e40d62-e24d-476b-804b-0cf407a7ace4]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260]
Jul 27 09:41:50 user nova-compute[70374]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260] successful.
Jul 27 09:41:50 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc1a41d-e92c-458e-933f-d54e9f5468aa]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== disconnect_volume: return (294ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:41:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:41:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance destroyed successfully.
Jul 27 09:41:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-423924851',display_name='tempest-ServerActionsTestOtherA-server-1522874168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-423924851',id=23,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-25r1p5d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=206f2727-3adb-4f39-b1d6-4ec1352e8cf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_vif [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e54f01f-07, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:51 user nova-compute[70374]: INFO os_vif [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07')
Jul 27 09:41:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrDofsOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:41:51 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd64ee0-ea21-4ef5-9e2e-954094a066f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:41:51 user nova-compute[70374]: No targets found.
Jul 27 09:41:51 user nova-compute[70374]: iSNS:
Jul 27 09:41:51 user nova-compute[70374]: No targets found.
Jul 27 09:41:51 user nova-compute[70374]: STATIC:
Jul 27 09:41:51 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:41:51 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:51 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:51 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:41:51 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:41:51 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:41:51 user nova-compute[70374]: FIRMWARE:
Jul 27 09:41:51 user nova-compute[70374]: No targets found.
Jul 27 09:41:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:41:51 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:41:51 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[85682cbb-5913-4715-873f-0cac0a590e30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dbe9a3-347e-4ae9-9b4d-05eddad3811e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:51 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:41:51 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:41:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc432c20>, {}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Disconnecting from: [] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== disconnect_volume: return (80ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:41:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Deleting instance files /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8_del
Jul 27 09:41:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Deletion of /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8_del complete
Jul 27 09:41:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-e812514a-0906-4a68-bedd-251d877d56ed req-0343b252-ef08-474d-b335-e5979f0a1526 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e812514a-0906-4a68-bedd-251d877d56ed req-0343b252-ef08-474d-b335-e5979f0a1526 service nova] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e812514a-0906-4a68-bedd-251d877d56ed req-0343b252-ef08-474d-b335-e5979f0a1526 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e812514a-0906-4a68-bedd-251d877d56ed req-0343b252-ef08-474d-b335-e5979f0a1526 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-e812514a-0906-4a68-bedd-251d877d56ed req-0343b252-ef08-474d-b335-e5979f0a1526 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] No waiting events found dispatching network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:41:51 user nova-compute[70374]: WARNING nova.compute.manager [req-e812514a-0906-4a68-bedd-251d877d56ed req-0343b252-ef08-474d-b335-e5979f0a1526 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received unexpected event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a for instance with vm_state active and task_state rebuilding.
Jul 27 09:41:52 user nova-compute[70374]: INFO nova.virt.block_device [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Booting with volume d85fc96b-076c-4399-a10f-a6468bb76248 at /dev/vdb
Jul 27 09:41:52 user nova-compute[70374]: DEBUG os_brick.utils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8349a0-fb4e-49e0-8781-7de597c9ecfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3f211-ea92-465b-9f20-d4f3a67af91d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[612f8049-a2f9-4765-acd9-160b71aa7603]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8abe2e-9fc6-4f7d-8bfc-52b2ee7e3767]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:41:52 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:41:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d32b4f-e3b8-4114-ae7c-aced9e10166d]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG os_brick.utils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:41:52 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating existing volume attachment record: e74901c3-ddf1-400b-a5a7-9f63388d0143 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:41:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:41:59 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Creating image(s)
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.258s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk 1073741824" returned: 0 in 0.049s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:41:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Cannot resize image /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Ensure instance console log exists: /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Start _get_guest_xml network_info=[{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'e74901c3-ddf1-400b-a5a7-9f63388d0143', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrDofsOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '206f2727-3adb-4f39-b1d6-4ec1352e8cf8', 'attached_at': '', 'detached_at': '', 'volume_id': 'd85fc96b-076c-4399-a10f-a6468bb76248', 'serial': 'd85fc96b-076c-4399-a10f-a6468bb76248'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:42:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 09:42:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'vcpu_model' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrDofsOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:42:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:42:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:42:00 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5416ce-c4f1-4d54-83ad-03c79a423e93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:42:00 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb5a42-8c45-48de-954c-df95328f196d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248] added
Jul 27 09:42:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ac82e1-19dd-48df-9183-2367c892ad89]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd3a12b-2f04-432a-8e5d-38bca6918275]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrDofsOF {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrDofsOF" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f5485-1c31-45d2-a864-8160c4e4b48c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xrDofsOF'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd01f3ef-8373-45a1-bb5f-31903649dd44]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b108a-955d-4037-a787-360b5f6cdab1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc2c7df-ace3-42d2-bea4-725f7728e283]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260]
Jul 27 09:42:00 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260] successful.
Jul 27 09:42:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa85273f-2616-461e-9a74-784092e23943]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5123225-d01f-4d73-ad27-9813e6a7cdc8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4918543-9b0f-40a0-bcec-650634b39a5a]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:42:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrDofsOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23765323638613635', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765323638613635', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-423924851',display_name='tempest-ServerActionsTestOtherA-server-1522874168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-423924851',id=23,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-25r1p5d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:41:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=206f2727-3adb-4f39-b1d6-4ec1352e8cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:42:01 user nova-compute[70374]:   <uuid>206f2727-3adb-4f39-b1d6-4ec1352e8cf8</uuid>
Jul 27 09:42:01 user nova-compute[70374]:   <name>instance-00000017</name>
Jul 27 09:42:01 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:42:01 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:42:01 user nova-compute[70374]:   <metadata>
Jul 27 09:42:01 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:42:01 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:42:01 user nova-compute[70374]:       <nova:name>tempest-ServerActionsTestOtherA-server-1522874168</nova:name>
Jul 27 09:42:01 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:42:00</nova:creationTime>
Jul 27 09:42:01 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:42:01 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:42:01 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:42:01 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:42:01 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:42:01 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:42:01 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:42:01 user nova-compute[70374]:       <nova:owner>
Jul 27 09:42:01 user nova-compute[70374]:         <nova:user uuid="a2b416973f744369818b2a67bcecdeb9">tempest-ServerActionsTestOtherA-2053926798-project-member</nova:user>
Jul 27 09:42:01 user nova-compute[70374]:         <nova:project uuid="f06bd4d4e7144fbc99c907fb405b7e99">tempest-ServerActionsTestOtherA-2053926798</nova:project>
Jul 27 09:42:01 user nova-compute[70374]:       </nova:owner>
Jul 27 09:42:01 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:42:01 user nova-compute[70374]:       <nova:ports>
Jul 27 09:42:01 user nova-compute[70374]:         <nova:port uuid="5e54f01f-0732-4e78-bcc1-f9e45af08a0a">
Jul 27 09:42:01 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 09:42:01 user nova-compute[70374]:         </nova:port>
Jul 27 09:42:01 user nova-compute[70374]:       </nova:ports>
Jul 27 09:42:01 user nova-compute[70374]:     </nova:instance>
Jul 27 09:42:01 user nova-compute[70374]:   </metadata>
Jul 27 09:42:01 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:42:01 user nova-compute[70374]:     <system>
Jul 27 09:42:01 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:42:01 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:42:01 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:42:01 user nova-compute[70374]:       <entry name="serial">206f2727-3adb-4f39-b1d6-4ec1352e8cf8</entry>
Jul 27 09:42:01 user nova-compute[70374]:       <entry name="uuid">206f2727-3adb-4f39-b1d6-4ec1352e8cf8</entry>
Jul 27 09:42:01 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:42:01 user nova-compute[70374]:     </system>
Jul 27 09:42:01 user nova-compute[70374]:   </sysinfo>
Jul 27 09:42:01 user nova-compute[70374]:   <os>
Jul 27 09:42:01 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:42:01 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:42:01 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:42:01 user nova-compute[70374]:   </os>
Jul 27 09:42:01 user nova-compute[70374]:   <features>
Jul 27 09:42:01 user nova-compute[70374]:     <acpi/>
Jul 27 09:42:01 user nova-compute[70374]:     <apic/>
Jul 27 09:42:01 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:42:01 user nova-compute[70374]:   </features>
Jul 27 09:42:01 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:42:01 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:42:01 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:42:01 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:42:01 user nova-compute[70374]:   </clock>
Jul 27 09:42:01 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:42:01 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:42:01 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:42:01 user nova-compute[70374]:   </cpu>
Jul 27 09:42:01 user nova-compute[70374]:   <devices>
Jul 27 09:42:01 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:42:01 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:42:01 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk"/>
Jul 27 09:42:01 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:42:01 user nova-compute[70374]:     </disk>
Jul 27 09:42:01 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:42:01 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:42:01 user nova-compute[70374]:       <source dev="/dev/sdd"/>
Jul 27 09:42:01 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:42:01 user nova-compute[70374]:       <serial>d85fc96b-076c-4399-a10f-a6468bb76248</serial>
Jul 27 09:42:01 user nova-compute[70374]:     </disk>
Jul 27 09:42:01 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:42:01 user nova-compute[70374]:       <mac address="fa:16:3e:8f:9b:7f"/>
Jul 27 09:42:01 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:42:01 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:42:01 user nova-compute[70374]:       <target dev="tap5e54f01f-07"/>
Jul 27 09:42:01 user nova-compute[70374]:     </interface>
Jul 27 09:42:01 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:42:01 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/console.log" append="off"/>
Jul 27 09:42:01 user nova-compute[70374]:     </serial>
Jul 27 09:42:01 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:42:01 user nova-compute[70374]:     <video>
Jul 27 09:42:01 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:42:01 user nova-compute[70374]:     </video>
Jul 27 09:42:01 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:42:01 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:42:01 user nova-compute[70374]:     </rng>
Jul 27 09:42:01 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:42:01 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:42:01 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:42:01 user nova-compute[70374]:     </memballoon>
Jul 27 09:42:01 user nova-compute[70374]:   </devices>
Jul 27 09:42:01 user nova-compute[70374]: </domain>
Jul 27 09:42:01 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-423924851',display_name='tempest-ServerActionsTestOtherA-server-1522874168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-423924851',id=23,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-25r1p5d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:41:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=206f2727-3adb-4f39-b1d6-4ec1352e8cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG os_vif [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e54f01f-07, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e54f01f-07, col_values=(('external_ids', {'iface-id': '5e54f01f-0732-4e78-bcc1-f9e45af08a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:9b:7f', 'vm-uuid': '206f2727-3adb-4f39-b1d6-4ec1352e8cf8'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:01 user nova-compute[70374]: INFO os_vif [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07')
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:42:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No VIF found with MAC fa:16:3e:8f:9b:7f, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:42:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-ca1e772b-a137-4a70-8dfb-7f02e4d1555c req-83cef91e-479f-4ed5-afb0-0e8ff58ac6e9 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ca1e772b-a137-4a70-8dfb-7f02e4d1555c req-83cef91e-479f-4ed5-afb0-0e8ff58ac6e9 service nova] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ca1e772b-a137-4a70-8dfb-7f02e4d1555c req-83cef91e-479f-4ed5-afb0-0e8ff58ac6e9 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ca1e772b-a137-4a70-8dfb-7f02e4d1555c req-83cef91e-479f-4ed5-afb0-0e8ff58ac6e9 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-ca1e772b-a137-4a70-8dfb-7f02e4d1555c req-83cef91e-479f-4ed5-afb0-0e8ff58ac6e9 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] No waiting events found dispatching network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:03 user nova-compute[70374]: WARNING nova.compute.manager [req-ca1e772b-a137-4a70-8dfb-7f02e4d1555c req-83cef91e-479f-4ed5-afb0-0e8ff58ac6e9 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received unexpected event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a for instance with vm_state active and task_state rebuild_spawning.
Jul 27 09:42:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450910.2951064, 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:05 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] VM Stopped (Lifecycle Event)
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-494908e0-d0aa-477c-b7c4-ec6888762010 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450925.459972, 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:05 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] VM Resumed (Lifecycle Event)
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:42:05 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance spawned successfully.
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:05 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450925.463002, 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:05 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] VM Started (Lifecycle Event)
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:42:05 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.objects.instance [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70374) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-92a92d70-1793-4b25-8543-da497cce83d6 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-afab2dc5-141b-4a4c-a5fb-dfc85d79c310 req-b99bf6c4-926e-4c76-8f36-993a57f95921 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-afab2dc5-141b-4a4c-a5fb-dfc85d79c310 req-b99bf6c4-926e-4c76-8f36-993a57f95921 service nova] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-afab2dc5-141b-4a4c-a5fb-dfc85d79c310 req-b99bf6c4-926e-4c76-8f36-993a57f95921 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-afab2dc5-141b-4a4c-a5fb-dfc85d79c310 req-b99bf6c4-926e-4c76-8f36-993a57f95921 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:05 user nova-compute[70374]: DEBUG nova.compute.manager [req-afab2dc5-141b-4a4c-a5fb-dfc85d79c310 req-b99bf6c4-926e-4c76-8f36-993a57f95921 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] No waiting events found dispatching network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:05 user nova-compute[70374]: WARNING nova.compute.manager [req-afab2dc5-141b-4a4c-a5fb-dfc85d79c310 req-b99bf6c4-926e-4c76-8f36-993a57f95921 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received unexpected event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a for instance with vm_state active and task_state None.
Jul 27 09:42:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:06 user nova-compute[70374]: INFO nova.compute.manager [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Detaching volume 4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:42:06 user nova-compute[70374]: INFO nova.virt.block_device [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Attempting to driver detach volume 4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 from mountpoint /dev/vdb
Jul 27 09:42:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Attempting to detach device vdb from instance 69a59942-cd83-4f74-82ea-f23a6538cef9 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:42:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:42:06 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:42:06 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:42:06 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:42:06 user nova-compute[70374]:   <serial>4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3</serial>
Jul 27 09:42:06 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:42:06 user nova-compute[70374]: </disk>
Jul 27 09:42:06 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:42:06 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Successfully detached device vdb from instance 69a59942-cd83-4f74-82ea-f23a6538cef9 from the persistent domain config.
Jul 27 09:42:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69a59942-cd83-4f74-82ea-f23a6538cef9 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:42:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:42:06 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:42:06 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:42:06 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:42:06 user nova-compute[70374]:   <serial>4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3</serial>
Jul 27 09:42:06 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:42:06 user nova-compute[70374]: </disk>
Jul 27 09:42:06 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450927.1854353, 69a59942-cd83-4f74-82ea-f23a6538cef9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:42:07 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Successfully detached device vdb from instance 69a59942-cd83-4f74-82ea-f23a6538cef9 from the live domain config.
Jul 27 09:42:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyEgrLbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:42:07 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03dd9c-1f97-447f-8723-12e4e29aa545]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:42:07 user nova-compute[70374]: No targets found.
Jul 27 09:42:07 user nova-compute[70374]: iSNS:
Jul 27 09:42:07 user nova-compute[70374]: No targets found.
Jul 27 09:42:07 user nova-compute[70374]: STATIC:
Jul 27 09:42:07 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:42:07 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:42:07 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:42:07 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:42:07 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:42:07 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:42:07 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3
Jul 27 09:42:07 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:42:07 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:42:07 user nova-compute[70374]: FIRMWARE:
Jul 27 09:42:07 user nova-compute[70374]: No targets found.
Jul 27 09:42:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:42:07 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:42:07 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da4cc0a-b33f-4b83-a776-62bcc78f3ee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[024531f5-4852-4071-8496-06289daea2c1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:42:07 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:07 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 (non-flash)
Jul 27 09:42:07 user nova-compute[70374]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:07 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280b83b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ef9b11-4115-4c4e-a0f9-fb024a64295d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e93b506-85f0-478b-9329-014a4a8ee1ac]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc03e66-8952-49c0-a6af-6153b762ffcf]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a31e764-25ba-4e5d-b7c3-df0932aba5f8]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[14197d17-2baa-4ac1-adcf-4ae40b1c1f4d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2223d2-52b6-48d4-b78e-8833a2a4f744]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3, portal: 172.16.0.220,3260]
Jul 27 09:42:07 user nova-compute[70374]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3, portal: 172.16.0.220,3260] successful.
Jul 27 09:42:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f66f3c5-8a77-4b12-a267-ff1f11a0e2c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4c6b6-7bc4-4340-8ab0-4f17e61e03ab]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] <== disconnect_volume: return (319ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:42:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:42:08 user nova-compute[70374]: DEBUG nova.objects.instance [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'flavor' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a09a42-a6f5-483e-94ee-93a5f1cfcfed tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.808s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:08 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:42:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:08 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:42:08 user nova-compute[70374]: INFO nova.compute.claims [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Claim successful on node user
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:42:09 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.policy [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '906960beba9548c1b0bfb37011957bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6457496dd4d54638a58c4e731420e473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:42:09 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Creating image(s)
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk 1073741824" returned: 0 in 0.058s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.175s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Successfully created port: ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Cannot resize image /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.objects.instance [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'migration_context' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Ensure instance console log exists: /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Successfully updated port: ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-b8c5c9f0-375f-482a-a866-01cfb4569979 req-7e13a860-a0fc-47ae-a572-00678dbbca57 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-changed-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-b8c5c9f0-375f-482a-a866-01cfb4569979 req-7e13a860-a0fc-47ae-a572-00678dbbca57 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Refreshing instance network info cache due to event network-changed-ad798508-8253-45fd-874b-abfa6dc1b966. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b8c5c9f0-375f-482a-a866-01cfb4569979 req-7e13a860-a0fc-47ae-a572-00678dbbca57 service nova] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:42:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance network_info: |[{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b8c5c9f0-375f-482a-a866-01cfb4569979 req-7e13a860-a0fc-47ae-a572-00678dbbca57 service nova] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.network.neutron [req-b8c5c9f0-375f-482a-a866-01cfb4569979 req-7e13a860-a0fc-47ae-a572-00678dbbca57 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Refreshing network info cache for port ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Start _get_guest_xml network_info=[{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:42:11 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:42:11 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.objects.instance [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'pci_devices' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:42:11 user nova-compute[70374]:   <uuid>bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</uuid>
Jul 27 09:42:11 user nova-compute[70374]:   <name>instance-0000001f</name>
Jul 27 09:42:11 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:42:11 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:42:11 user nova-compute[70374]:   <metadata>
Jul 27 09:42:11 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:42:11 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:42:11 user nova-compute[70374]:       <nova:name>tempest-ServerActionsTestOtherB-server-320285733</nova:name>
Jul 27 09:42:11 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:42:11</nova:creationTime>
Jul 27 09:42:11 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:42:11 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:42:11 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:42:11 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:42:11 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:42:11 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:42:11 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:42:11 user nova-compute[70374]:       <nova:owner>
Jul 27 09:42:11 user nova-compute[70374]:         <nova:user uuid="906960beba9548c1b0bfb37011957bd7">tempest-ServerActionsTestOtherB-247493366-project-member</nova:user>
Jul 27 09:42:11 user nova-compute[70374]:         <nova:project uuid="6457496dd4d54638a58c4e731420e473">tempest-ServerActionsTestOtherB-247493366</nova:project>
Jul 27 09:42:11 user nova-compute[70374]:       </nova:owner>
Jul 27 09:42:11 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:42:11 user nova-compute[70374]:       <nova:ports>
Jul 27 09:42:11 user nova-compute[70374]:         <nova:port uuid="ad798508-8253-45fd-874b-abfa6dc1b966">
Jul 27 09:42:11 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 09:42:11 user nova-compute[70374]:         </nova:port>
Jul 27 09:42:11 user nova-compute[70374]:       </nova:ports>
Jul 27 09:42:11 user nova-compute[70374]:     </nova:instance>
Jul 27 09:42:11 user nova-compute[70374]:   </metadata>
Jul 27 09:42:11 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:42:11 user nova-compute[70374]:     <system>
Jul 27 09:42:11 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:42:11 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:42:11 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:42:11 user nova-compute[70374]:       <entry name="serial">bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</entry>
Jul 27 09:42:11 user nova-compute[70374]:       <entry name="uuid">bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</entry>
Jul 27 09:42:11 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:42:11 user nova-compute[70374]:     </system>
Jul 27 09:42:11 user nova-compute[70374]:   </sysinfo>
Jul 27 09:42:11 user nova-compute[70374]:   <os>
Jul 27 09:42:11 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:42:11 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:42:11 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:42:11 user nova-compute[70374]:   </os>
Jul 27 09:42:11 user nova-compute[70374]:   <features>
Jul 27 09:42:11 user nova-compute[70374]:     <acpi/>
Jul 27 09:42:11 user nova-compute[70374]:     <apic/>
Jul 27 09:42:11 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:42:11 user nova-compute[70374]:   </features>
Jul 27 09:42:11 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:42:11 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:42:11 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:42:11 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:42:11 user nova-compute[70374]:   </clock>
Jul 27 09:42:11 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:42:11 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:42:11 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:42:11 user nova-compute[70374]:   </cpu>
Jul 27 09:42:11 user nova-compute[70374]:   <devices>
Jul 27 09:42:11 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:42:11 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:42:11 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk"/>
Jul 27 09:42:11 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:42:11 user nova-compute[70374]:     </disk>
Jul 27 09:42:11 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:42:11 user nova-compute[70374]:       <mac address="fa:16:3e:d1:c6:60"/>
Jul 27 09:42:11 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:42:11 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:42:11 user nova-compute[70374]:       <target dev="tapad798508-82"/>
Jul 27 09:42:11 user nova-compute[70374]:     </interface>
Jul 27 09:42:11 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:42:11 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/console.log" append="off"/>
Jul 27 09:42:11 user nova-compute[70374]:     </serial>
Jul 27 09:42:11 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:42:11 user nova-compute[70374]:     <video>
Jul 27 09:42:11 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:42:11 user nova-compute[70374]:     </video>
Jul 27 09:42:11 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:42:11 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:42:11 user nova-compute[70374]:     </rng>
Jul 27 09:42:11 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:42:11 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:42:11 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:42:11 user nova-compute[70374]:     </memballoon>
Jul 27 09:42:11 user nova-compute[70374]:   </devices>
Jul 27 09:42:11 user nova-compute[70374]: </domain>
Jul 27 09:42:11 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG os_vif [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad798508-82, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad798508-82, col_values=(('external_ids', {'iface-id': 'ad798508-8253-45fd-874b-abfa6dc1b966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:c6:60', 'vm-uuid': 'bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:11 user nova-compute[70374]: INFO os_vif [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82')
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] No VIF found with MAC fa:16:3e:d1:c6:60, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:42:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-b8c5c9f0-375f-482a-a866-01cfb4569979 req-7e13a860-a0fc-47ae-a572-00678dbbca57 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updated VIF entry in instance network info cache for port ad798508-8253-45fd-874b-abfa6dc1b966. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-b8c5c9f0-375f-482a-a866-01cfb4569979 req-7e13a860-a0fc-47ae-a572-00678dbbca57 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b8c5c9f0-375f-482a-a866-01cfb4569979 req-7e13a860-a0fc-47ae-a572-00678dbbca57 service nova] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-bc670776-6de3-4018-9488-0b6897f9fa85 req-4de20ab4-cd66-46c6-8998-a3f18322167b service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc670776-6de3-4018-9488-0b6897f9fa85 req-4de20ab4-cd66-46c6-8998-a3f18322167b service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc670776-6de3-4018-9488-0b6897f9fa85 req-4de20ab4-cd66-46c6-8998-a3f18322167b service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc670776-6de3-4018-9488-0b6897f9fa85 req-4de20ab4-cd66-46c6-8998-a3f18322167b service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-bc670776-6de3-4018-9488-0b6897f9fa85 req-4de20ab4-cd66-46c6-8998-a3f18322167b service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:13 user nova-compute[70374]: WARNING nova.compute.manager [req-bc670776-6de3-4018-9488-0b6897f9fa85 req-4de20ab4-cd66-46c6-8998-a3f18322167b service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state building and task_state spawning.
Jul 27 09:42:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:14 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450934.9713943, bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:14 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] VM Resumed (Lifecycle Event)
Jul 27 09:42:14 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:42:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:42:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:14 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance spawned successfully.
Jul 27 09:42:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:42:15 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450934.9745498, bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:15 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] VM Started (Lifecycle Event)
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-7d6c526c-ee6c-4257-9391-d21c2957c46f req-b6c2b99d-0376-4664-8ffa-d8196b2e9a9c service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7d6c526c-ee6c-4257-9391-d21c2957c46f req-b6c2b99d-0376-4664-8ffa-d8196b2e9a9c service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7d6c526c-ee6c-4257-9391-d21c2957c46f req-b6c2b99d-0376-4664-8ffa-d8196b2e9a9c service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7d6c526c-ee6c-4257-9391-d21c2957c46f req-b6c2b99d-0376-4664-8ffa-d8196b2e9a9c service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-7d6c526c-ee6c-4257-9391-d21c2957c46f req-b6c2b99d-0376-4664-8ffa-d8196b2e9a9c service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:15 user nova-compute[70374]: WARNING nova.compute.manager [req-7d6c526c-ee6c-4257-9391-d21c2957c46f req-b6c2b99d-0376-4664-8ffa-d8196b2e9a9c service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state building and task_state spawning.
Jul 27 09:42:15 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:42:15 user nova-compute[70374]: INFO nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Took 5.64 seconds to spawn the instance on the hypervisor.
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:15 user nova-compute[70374]: INFO nova.compute.manager [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Took 6.61 seconds to build instance.
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16266207-b9ce-4ac0-8381-1d2ba19c9845 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.712s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:19 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:42:19 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7443MB free_disk=25.394367218017578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 69a59942-cd83-4f74-82ea-f23a6538cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 66911d11-4025-4243-9f8e-ff0909460190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 38e29c83-3067-492a-9b4c-953f5344ba2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 56ab07d0-823d-4282-bdc5-21910c33678a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:42:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-39c905e2-3ed7-4d2c-9aa9-40115102a316 req-b430a70f-4968-419f-9d76-bf4cc9fb2173 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received event network-changed-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-39c905e2-3ed7-4d2c-9aa9-40115102a316 req-b430a70f-4968-419f-9d76-bf4cc9fb2173 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Refreshing instance network info cache due to event network-changed-e9b57f91-ad8d-4146-a6e4-9138309aa071. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39c905e2-3ed7-4d2c-9aa9-40115102a316 req-b430a70f-4968-419f-9d76-bf4cc9fb2173 service nova] Acquiring lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39c905e2-3ed7-4d2c-9aa9-40115102a316 req-b430a70f-4968-419f-9d76-bf4cc9fb2173 service nova] Acquired lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-39c905e2-3ed7-4d2c-9aa9-40115102a316 req-b430a70f-4968-419f-9d76-bf4cc9fb2173 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Refreshing network info cache for port e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-39c905e2-3ed7-4d2c-9aa9-40115102a316 req-b430a70f-4968-419f-9d76-bf4cc9fb2173 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Updated VIF entry in instance network info cache for port e9b57f91-ad8d-4146-a6e4-9138309aa071. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-39c905e2-3ed7-4d2c-9aa9-40115102a316 req-b430a70f-4968-419f-9d76-bf4cc9fb2173 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Updating instance_info_cache with network_info: [{"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39c905e2-3ed7-4d2c-9aa9-40115102a316 req-b430a70f-4968-419f-9d76-bf4cc9fb2173 service nova] Releasing lock "refresh_cache-38e29c83-3067-492a-9b4c-953f5344ba2a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:42:40 user nova-compute[70374]: INFO nova.compute.manager [None req-7fe347a1-d9e3-4595-8364-7d7f37492a05 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Unrescuing
Jul 27 09:42:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7fe347a1-d9e3-4595-8364-7d7f37492a05 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7fe347a1-d9e3-4595-8364-7d7f37492a05 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquired lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:42:40 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7fe347a1-d9e3-4595-8364-7d7f37492a05 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7fe347a1-d9e3-4595-8364-7d7f37492a05 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7fe347a1-d9e3-4595-8364-7d7f37492a05 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Releasing lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7fe347a1-d9e3-4595-8364-7d7f37492a05 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'flavor' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-78d803ad-bea7-41ef-a0aa-60746c4e7bbf req-f4349699-7bfc-4158-8970-2e092d7583cf service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-78d803ad-bea7-41ef-a0aa-60746c4e7bbf req-f4349699-7bfc-4158-8970-2e092d7583cf service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-78d803ad-bea7-41ef-a0aa-60746c4e7bbf req-f4349699-7bfc-4158-8970-2e092d7583cf service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-78d803ad-bea7-41ef-a0aa-60746c4e7bbf req-f4349699-7bfc-4158-8970-2e092d7583cf service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-78d803ad-bea7-41ef-a0aa-60746c4e7bbf req-f4349699-7bfc-4158-8970-2e092d7583cf service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:41 user nova-compute[70374]: WARNING nova.compute.manager [req-78d803ad-bea7-41ef-a0aa-60746c4e7bbf req-f4349699-7bfc-4158-8970-2e092d7583cf service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:42:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance destroyed successfully.
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid 38e29c83-3067-492a-9b4c-953f5344ba2a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:43 user nova-compute[70374]: WARNING nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:43 user nova-compute[70374]: WARNING nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:43 user nova-compute[70374]: WARNING nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:43 user nova-compute[70374]: WARNING nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:43 user nova-compute[70374]: WARNING nova.compute.manager [req-0da10e2e-e7c2-4c45-b40e-08514fd62420 req-3ef0399c-c90c-4aa2-86ce-f588cf38434c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:44 user nova-compute[70374]: INFO nova.compute.manager [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Attaching volume d9b74bbc-58c7-4c5f-97d6-20b8520411fc to /dev/vdb
Jul 27 09:42:44 user nova-compute[70374]: DEBUG os_brick.utils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[699b6df5-a4f5-4b89-bd6e-c3812608ab5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e707993-530b-420c-9814-dfda4e595fe2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eccb43-e646-47ee-a18e-ca9158d9f0bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1f658-9e7c-48f5-b6c3-0f4574ce202e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:42:44 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cda034-e9ea-4346-add1-28a6bd77279c]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG os_brick.utils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Updating existing volume attachment record: 21a03ad6-8e7d-4f9c-ac1e-368840141143 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:42:44 user nova-compute[70374]: INFO nova.compute.claims [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Claim successful on node user
Jul 27 09:42:44 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:45 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:42:45 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Creating image(s)
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "/opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "/opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "/opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.policy [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce8d942c3b93453bafa8381f39ec85a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d47c627f4a94472a80b922a262aa172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk 1073741824" returned: 0 in 0.058s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Cannot resize image /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.objects.instance [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'migration_context' on Instance uuid 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Ensure instance console log exists: /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Successfully created port: 10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 66911d11-4025-4243-9f8e-ff0909460190 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450965.9989085, 66911d11-4025-4243-9f8e-ff0909460190 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:46 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] VM Resumed (Lifecycle Event)
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7fe347a1-d9e3-4595-8364-7d7f37492a05 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:42:46 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450966.0013459, 66911d11-4025-4243-9f8e-ff0909460190 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:46 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] VM Started (Lifecycle Event)
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:46 user nova-compute[70374]: WARNING nova.compute.manager [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-changed-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Refreshing instance network info cache due to event network-changed-db247eac-602c-4249-9473-94ee4a0dcfea. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Acquiring lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Acquired lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.network.neutron [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Refreshing network info cache for port db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:42:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Updated VIF entry in instance network info cache for port db247eac-602c-4249-9473-94ee4a0dcfea. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Updating instance_info_cache with network_info: [{"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Releasing lock "refresh_cache-209af1ec-b5cb-491c-9854-8ff3a8b31b13" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:47 user nova-compute[70374]: WARNING nova.compute.manager [req-0152a5f0-d017-4f40-bec0-97de2626d3fc req-c227eef0-3799-4dc6-b49e-cbd6cf35ce2c service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Successfully updated port: 10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquired lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-9e82df68-c88c-42e4-9280-95fd22c6a707 req-2aab3d64-68dc-4ed6-81bf-6a0c9b1ef86c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received event network-changed-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-9e82df68-c88c-42e4-9280-95fd22c6a707 req-2aab3d64-68dc-4ed6-81bf-6a0c9b1ef86c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Refreshing instance network info cache due to event network-changed-10f91912-fc13-4fb8-a5eb-a47f17b5e749. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9e82df68-c88c-42e4-9280-95fd22c6a707 req-2aab3d64-68dc-4ed6-81bf-6a0c9b1ef86c service nova] Acquiring lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Updating instance_info_cache with network_info: [{"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Releasing lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Instance network_info: |[{"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9e82df68-c88c-42e4-9280-95fd22c6a707 req-2aab3d64-68dc-4ed6-81bf-6a0c9b1ef86c service nova] Acquired lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-9e82df68-c88c-42e4-9280-95fd22c6a707 req-2aab3d64-68dc-4ed6-81bf-6a0c9b1ef86c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Refreshing network info cache for port 10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Start _get_guest_xml network_info=[{"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:42:47 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:42:47 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:42:47 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-964408504',display_name='tempest-VolumesSnapshotTestJSON-instance-964408504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-964408504',id=32,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh1jcYHkrJFF9aYp70HLhkQN+PpTv2JGCPlZhHUMv5uC4j1qzjlbcl9o/cOvCnHucFRvDybjYsO19309Ok47edVpSIVz1t5faEOyPevp9qqI3C4tX6aMCeEo335YZdH9Q==',key_name='tempest-keypair-571414827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d47c627f4a94472a80b922a262aa172',ramdisk_id='',reservation_id='r-h5z4odtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1299698694',owner_user_name='tempest-VolumesSnapshotTestJSON-1299698694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8d942c3b93453bafa8381f39ec85a9',uuid=1695cfe5-48ad-4d44-8eeb-7a3064f05ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converting VIF {"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=10f91912-fc13-4fb8-a5eb-a47f17b5e749,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f91912-fc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'pci_devices' on Instance uuid 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:42:48 user nova-compute[70374]:   <uuid>1695cfe5-48ad-4d44-8eeb-7a3064f05ae8</uuid>
Jul 27 09:42:48 user nova-compute[70374]:   <name>instance-00000020</name>
Jul 27 09:42:48 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:42:48 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:42:48 user nova-compute[70374]:   <metadata>
Jul 27 09:42:48 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:42:48 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:42:48 user nova-compute[70374]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-964408504</nova:name>
Jul 27 09:42:48 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:42:47</nova:creationTime>
Jul 27 09:42:48 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:42:48 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:42:48 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:42:48 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:42:48 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:42:48 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:42:48 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:42:48 user nova-compute[70374]:       <nova:owner>
Jul 27 09:42:48 user nova-compute[70374]:         <nova:user uuid="ce8d942c3b93453bafa8381f39ec85a9">tempest-VolumesSnapshotTestJSON-1299698694-project-member</nova:user>
Jul 27 09:42:48 user nova-compute[70374]:         <nova:project uuid="5d47c627f4a94472a80b922a262aa172">tempest-VolumesSnapshotTestJSON-1299698694</nova:project>
Jul 27 09:42:48 user nova-compute[70374]:       </nova:owner>
Jul 27 09:42:48 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:42:48 user nova-compute[70374]:       <nova:ports>
Jul 27 09:42:48 user nova-compute[70374]:         <nova:port uuid="10f91912-fc13-4fb8-a5eb-a47f17b5e749">
Jul 27 09:42:48 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 09:42:48 user nova-compute[70374]:         </nova:port>
Jul 27 09:42:48 user nova-compute[70374]:       </nova:ports>
Jul 27 09:42:48 user nova-compute[70374]:     </nova:instance>
Jul 27 09:42:48 user nova-compute[70374]:   </metadata>
Jul 27 09:42:48 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:42:48 user nova-compute[70374]:     <system>
Jul 27 09:42:48 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:42:48 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:42:48 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:42:48 user nova-compute[70374]:       <entry name="serial">1695cfe5-48ad-4d44-8eeb-7a3064f05ae8</entry>
Jul 27 09:42:48 user nova-compute[70374]:       <entry name="uuid">1695cfe5-48ad-4d44-8eeb-7a3064f05ae8</entry>
Jul 27 09:42:48 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:42:48 user nova-compute[70374]:     </system>
Jul 27 09:42:48 user nova-compute[70374]:   </sysinfo>
Jul 27 09:42:48 user nova-compute[70374]:   <os>
Jul 27 09:42:48 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:42:48 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:42:48 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:42:48 user nova-compute[70374]:   </os>
Jul 27 09:42:48 user nova-compute[70374]:   <features>
Jul 27 09:42:48 user nova-compute[70374]:     <acpi/>
Jul 27 09:42:48 user nova-compute[70374]:     <apic/>
Jul 27 09:42:48 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:42:48 user nova-compute[70374]:   </features>
Jul 27 09:42:48 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:42:48 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:42:48 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:42:48 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:42:48 user nova-compute[70374]:   </clock>
Jul 27 09:42:48 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:42:48 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:42:48 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:42:48 user nova-compute[70374]:   </cpu>
Jul 27 09:42:48 user nova-compute[70374]:   <devices>
Jul 27 09:42:48 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:42:48 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:42:48 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk"/>
Jul 27 09:42:48 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:42:48 user nova-compute[70374]:     </disk>
Jul 27 09:42:48 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:42:48 user nova-compute[70374]:       <mac address="fa:16:3e:c5:bb:32"/>
Jul 27 09:42:48 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:42:48 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:42:48 user nova-compute[70374]:       <target dev="tap10f91912-fc"/>
Jul 27 09:42:48 user nova-compute[70374]:     </interface>
Jul 27 09:42:48 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:42:48 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/console.log" append="off"/>
Jul 27 09:42:48 user nova-compute[70374]:     </serial>
Jul 27 09:42:48 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:42:48 user nova-compute[70374]:     <video>
Jul 27 09:42:48 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:42:48 user nova-compute[70374]:     </video>
Jul 27 09:42:48 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:42:48 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:42:48 user nova-compute[70374]:     </rng>
Jul 27 09:42:48 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:42:48 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:42:48 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:42:48 user nova-compute[70374]:     </memballoon>
Jul 27 09:42:48 user nova-compute[70374]:   </devices>
Jul 27 09:42:48 user nova-compute[70374]: </domain>
Jul 27 09:42:48 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-964408504',display_name='tempest-VolumesSnapshotTestJSON-instance-964408504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-964408504',id=32,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh1jcYHkrJFF9aYp70HLhkQN+PpTv2JGCPlZhHUMv5uC4j1qzjlbcl9o/cOvCnHucFRvDybjYsO19309Ok47edVpSIVz1t5faEOyPevp9qqI3C4tX6aMCeEo335YZdH9Q==',key_name='tempest-keypair-571414827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d47c627f4a94472a80b922a262aa172',ramdisk_id='',reservation_id='r-h5z4odtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1299698694',owner_user_name='tempest-VolumesSnapshotTestJSON-1299698694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8d942c3b93453bafa8381f39ec85a9',uuid=1695cfe5-48ad-4d44-8eeb-7a3064f05ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converting VIF {"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=10f91912-fc13-4fb8-a5eb-a47f17b5e749,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f91912-fc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG os_vif [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=10f91912-fc13-4fb8-a5eb-a47f17b5e749,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f91912-fc') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10f91912-fc, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10f91912-fc, col_values=(('external_ids', {'iface-id': '10f91912-fc13-4fb8-a5eb-a47f17b5e749', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:bb:32', 'vm-uuid': '1695cfe5-48ad-4d44-8eeb-7a3064f05ae8'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:48 user nova-compute[70374]: INFO os_vif [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=10f91912-fc13-4fb8-a5eb-a47f17b5e749,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f91912-fc')
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No VIF found with MAC fa:16:3e:c5:bb:32, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.network.neutron [req-9e82df68-c88c-42e4-9280-95fd22c6a707 req-2aab3d64-68dc-4ed6-81bf-6a0c9b1ef86c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Updated VIF entry in instance network info cache for port 10f91912-fc13-4fb8-a5eb-a47f17b5e749. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.network.neutron [req-9e82df68-c88c-42e4-9280-95fd22c6a707 req-2aab3d64-68dc-4ed6-81bf-6a0c9b1ef86c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Updating instance_info_cache with network_info: [{"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9e82df68-c88c-42e4-9280-95fd22c6a707 req-2aab3d64-68dc-4ed6-81bf-6a0c9b1ef86c service nova] Releasing lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:48 user nova-compute[70374]: INFO nova.compute.manager [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Attaching volume ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae to /dev/vdb
Jul 27 09:42:48 user nova-compute[70374]: DEBUG os_brick.utils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cac6a2-1d11-40bf-8fa2-cc70a0894d5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf3a12f-0f9a-404a-b752-231d1e8ece75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b891331-a8fa-4ca9-a53a-218476135ecd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b95223-86ee-45e7-abf1-7baa0126cdd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:42:48 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:42:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e10254e-77e7-4069-a858-a14ba3156200]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG os_brick.utils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:42:48 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Updating existing volume attachment record: a34b7886-ba35-4827-8025-e8e8619b8612 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-2b2c7aed-bc47-490c-82e4-e50535825132 req-f17fab3f-e5b7-477b-8acb-e5b705dda101 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received event network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b2c7aed-bc47-490c-82e4-e50535825132 req-f17fab3f-e5b7-477b-8acb-e5b705dda101 service nova] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b2c7aed-bc47-490c-82e4-e50535825132 req-f17fab3f-e5b7-477b-8acb-e5b705dda101 service nova] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b2c7aed-bc47-490c-82e4-e50535825132 req-f17fab3f-e5b7-477b-8acb-e5b705dda101 service nova] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-2b2c7aed-bc47-490c-82e4-e50535825132 req-f17fab3f-e5b7-477b-8acb-e5b705dda101 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] No waiting events found dispatching network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:49 user nova-compute[70374]: WARNING nova.compute.manager [req-2b2c7aed-bc47-490c-82e4-e50535825132 req-f17fab3f-e5b7-477b-8acb-e5b705dda101 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received unexpected event network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 for instance with vm_state building and task_state spawning.
Jul 27 09:42:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450971.7727094, 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] VM Resumed (Lifecycle Event)
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:42:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Instance spawned successfully.
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:42:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690450971.7829192, 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:42:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] VM Started (Lifecycle Event)
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-fd7dfa5c-5610-4956-bde2-e43b91bda407 req-54cc90fa-e5a4-4336-8d8e-83c93393d2c5 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received event network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fd7dfa5c-5610-4956-bde2-e43b91bda407 req-54cc90fa-e5a4-4336-8d8e-83c93393d2c5 service nova] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fd7dfa5c-5610-4956-bde2-e43b91bda407 req-54cc90fa-e5a4-4336-8d8e-83c93393d2c5 service nova] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fd7dfa5c-5610-4956-bde2-e43b91bda407 req-54cc90fa-e5a4-4336-8d8e-83c93393d2c5 service nova] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-fd7dfa5c-5610-4956-bde2-e43b91bda407 req-54cc90fa-e5a4-4336-8d8e-83c93393d2c5 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] No waiting events found dispatching network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:42:51 user nova-compute[70374]: WARNING nova.compute.manager [req-fd7dfa5c-5610-4956-bde2-e43b91bda407 req-54cc90fa-e5a4-4336-8d8e-83c93393d2c5 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received unexpected event network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 for instance with vm_state building and task_state spawning.
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:42:51 user nova-compute[70374]: INFO nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Took 6.77 seconds to spawn the instance on the hypervisor.
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:42:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:42:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIitEgHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:42:51 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:42:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:42:51 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:42:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:42:51 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:42:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac0bf9-785a-48fe-a236-1165cf8ace42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:42:51 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c284fa52-5568-4c55-8fb6-18ec342e3e57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc] added
Jul 27 09:42:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: INFO nova.compute.manager [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Took 7.63 seconds to build instance.
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9628c5-2978-4a6e-833f-0edf6b086953]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f8b83480-c7e8-4227-b5a4-f447a5c2c118 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.748s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99a6604-50a7-4177-b0af-8e3ca22422f1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fIitEgHc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fIitEgHc" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8470bdc-bf29-4343-bab7-875c8d907a5b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fIitEgHc'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f2af95-ce6e-4bf4-8ec0-3670614bb582]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d029a73-f176-4c21-aa25-6f9dd9a6c3ce]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:52 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:52 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a3ca48-a38e-49af-93b2-f60f6d740ad3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc, portal: 172.16.0.220,3260]
Jul 27 09:42:52 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc, portal: 172.16.0.220,3260] successful.
Jul 27 09:42:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[02346598-a9b7-4a15-8290-23465738b7c4]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb680260-fc30-49c9-82a0-5182fee09e77]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:52 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:52 user nova-compute[70374]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc (non-flash)
Jul 27 09:42:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:52 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:52 user nova-compute[70374]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc (non-flash)
Jul 27 09:42:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[728e5766-34ca-4fa6-9e4b-f0c594795218]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:42:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIitEgHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23630353532376161', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630353532376161', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid 38e29c83-3067-492a-9b4c-953f5344ba2a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:42:53 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:42:53 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:42:53 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:42:53 user nova-compute[70374]:   <serial>d9b74bbc-58c7-4c5f-97d6-20b8520411fc</serial>
Jul 27 09:42:53 user nova-compute[70374]: </disk>
Jul 27 09:42:53 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:42:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] No VIF found with MAC fa:16:3e:bb:36:72, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:42:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a9f981d3-4ec4-4aa1-b018-06f81c3ef93e tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.924s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:42:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:42:55 user nova-compute[70374]: INFO nova.compute.manager [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Detaching volume d9b74bbc-58c7-4c5f-97d6-20b8520411fc
Jul 27 09:42:55 user nova-compute[70374]: INFO nova.virt.block_device [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Attempting to driver detach volume d9b74bbc-58c7-4c5f-97d6-20b8520411fc from mountpoint /dev/vdb
Jul 27 09:42:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Attempting to detach device vdb from instance 38e29c83-3067-492a-9b4c-953f5344ba2a from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:42:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:42:55 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:42:55 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:42:55 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:42:55 user nova-compute[70374]:   <serial>d9b74bbc-58c7-4c5f-97d6-20b8520411fc</serial>
Jul 27 09:42:55 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:42:55 user nova-compute[70374]: </disk>
Jul 27 09:42:55 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:42:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully detached device vdb from instance 38e29c83-3067-492a-9b4c-953f5344ba2a from the persistent domain config.
Jul 27 09:42:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38e29c83-3067-492a-9b4c-953f5344ba2a from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:42:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:42:55 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:42:55 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:42:55 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:42:55 user nova-compute[70374]:   <serial>d9b74bbc-58c7-4c5f-97d6-20b8520411fc</serial>
Jul 27 09:42:55 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:42:55 user nova-compute[70374]: </disk>
Jul 27 09:42:55 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450976.0978646, 38e29c83-3067-492a-9b4c-953f5344ba2a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38e29c83-3067-492a-9b4c-953f5344ba2a {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:42:56 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully detached device vdb from instance 38e29c83-3067-492a-9b4c-953f5344ba2a from the live domain config.
Jul 27 09:42:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIitEgHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:42:56 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc02b0ae-4a5b-4c87-bb27-cbdad4c725a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:42:56 user nova-compute[70374]: No targets found.
Jul 27 09:42:56 user nova-compute[70374]: iSNS:
Jul 27 09:42:56 user nova-compute[70374]: No targets found.
Jul 27 09:42:56 user nova-compute[70374]: STATIC:
Jul 27 09:42:56 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc
Jul 27 09:42:56 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:42:56 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:42:56 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:42:56 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:42:56 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:42:56 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:42:56 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:42:56 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:42:56 user nova-compute[70374]: FIRMWARE:
Jul 27 09:42:56 user nova-compute[70374]: No targets found.
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:42:56 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:42:56 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33e2d80-3113-4c1c-8fa0-2fcb0f8bf850]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[72106458-6053-432a-ab42-04b29bc1f12f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc (non-flash)
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc (non-flash)
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2809104040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555b51d-42de-451c-9a5b-11d8488f4d1d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa2454a-0009-44ed-891e-2ec863f2b546]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da84d33-2f9c-4b53-bc68-af2da9b6b5ef]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSzPlHey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:42:56 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b3a952-448f-44f7-9a1d-133da36234ed]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f7d4ca-1b3c-4743-a624-093a38c95ef8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a31216c-7225-4cf7-adec-86827c2a20ef]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc, portal: 172.16.0.220,3260]
Jul 27 09:42:56 user nova-compute[70374]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc, portal: 172.16.0.220,3260] successful.
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b74bbc-58c7-4c5f-97d6-20b8520411fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a26753-5ec5-4419-9b80-9cf45bbfe9fd]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] <== disconnect_volume: return (324ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.158s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:42:56 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:42:56 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d6a62e-7383-463b-aeac-ed7a931e3c3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:42:56 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[987b30d7-97c1-4e7e-9e4e-29bd8fe8af38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae] added
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a01138-60e2-4110-9f71-c97f3da9b2b9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c2e3ea-f8b7-407e-8935-9a30f5d49f8c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fSzPlHey {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fSzPlHey" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd2bc1-d45d-44ce-9ab9-bfd187939849]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fSzPlHey'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e104f7-7395-4863-9d44-fc30622f711f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ebdae7-8df9-4ff2-9779-b96f14f51f9c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b502d81-e788-4585-b4cf-dc82404d9e68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae, portal: 172.16.0.220,3260]
Jul 27 09:42:56 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae, portal: 172.16.0.220,3260] successful.
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe78802a-e8d8-4070-ba22-8b1d540293f0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa490a3-d1e2-4aa1-8e0b-2e79236012c0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:42:56 user nova-compute[70374]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)
Jul 27 09:42:56 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0192bf78-812d-4ecf-977f-37a7aaccf05c]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:42:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSzPlHey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:42:57 user nova-compute[70374]: DEBUG nova.objects.instance [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'flavor' on Instance uuid 38e29c83-3067-492a-9b4c-953f5344ba2a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-47a8aa2e-356f-4722-b445-7123f5b0322f tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.937s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:42:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:42:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== connect_volume: return (1517ms) {'type': 'block', 'scsi_wwn': '23132646166366534', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:42:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132646166366534', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:42:57 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:42:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:42:57 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:42:57 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:42:57 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:42:57 user nova-compute[70374]:   <serial>ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae</serial>
Jul 27 09:42:57 user nova-compute[70374]: </disk>
Jul 27 09:42:57 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:42:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:42:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:42:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:42:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No VIF found with MAC fa:16:3e:6a:d7:9f, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:42:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ec907b4e-4071-46dd-86ca-f4f82f7d8452 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.838s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG nova.objects.instance [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:03 user nova-compute[70374]: INFO nova.compute.manager [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Attaching volume 34b2885c-005c-42b8-b0e5-56c52edf9925 to /dev/vdc
Jul 27 09:43:03 user nova-compute[70374]: DEBUG os_brick.utils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a984dd-0a94-4bf0-979a-e120915e2925]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e855e79f-a985-491f-8e1e-5c815e8be8e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54142d4-6c1f-4441-be09-233567e0dbd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac83800f-e871-4dae-a7b2-2d533beacb19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:43:03 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[356325f6-e47e-4a07-8db1-cae53c75813a]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG os_brick.utils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Updating existing volume attachment record: efe8b6fa-b43b-4b9a-9baa-a68e35b64954 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:03 user nova-compute[70374]: INFO nova.compute.manager [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Terminating instance
Jul 27 09:43:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-8eb2716e-dddb-4bdc-b59a-81729adc5783 req-0c422574-2afc-4fc0-8a3a-e0d78647066e service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8eb2716e-dddb-4bdc-b59a-81729adc5783 req-0c422574-2afc-4fc0-8a3a-e0d78647066e service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8eb2716e-dddb-4bdc-b59a-81729adc5783 req-0c422574-2afc-4fc0-8a3a-e0d78647066e service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8eb2716e-dddb-4bdc-b59a-81729adc5783 req-0c422574-2afc-4fc0-8a3a-e0d78647066e service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-8eb2716e-dddb-4bdc-b59a-81729adc5783 req-0c422574-2afc-4fc0-8a3a-e0d78647066e service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-8eb2716e-dddb-4bdc-b59a-81729adc5783 req-0c422574-2afc-4fc0-8a3a-e0d78647066e service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-unplugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Instance destroyed successfully.
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lazy-loading 'resources' on Instance uuid 69a59942-cd83-4f74-82ea-f23a6538cef9 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-5155036',display_name='tempest-ServerStableDeviceRescueTest-server-5155036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-5155036',id=20,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6R6pxyWguYUpGbhXDryFF98r4EErMCAduikmtB8A7jMw32ji5zDskUehPZkgpAo/t9hS38SlQ9OuQGv2/gK7wmIRQk7DqCx9aHpB4MCMzUppNMZq/hdilw2TBZ+Ny5lg==',key_name='tempest-keypair-589835980',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb71f9530b5d43f28bde4f13f2200408',ramdisk_id='',reservation_id='r-4qrsflrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1292987631',owner_user_name='tempest-ServerStableDeviceRescueTest-1292987631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f9403033f534073a59cb12f3d02bc91',uuid=69a59942-cd83-4f74-82ea-f23a6538cef9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Converting VIF {"id": "08a126de-9aff-4def-baa5-0401181a8d3b", "address": "fa:16:3e:19:61:ec", "network": {"id": "5f60f46f-086a-4008-a28e-a5aee728a59e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-674514268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb71f9530b5d43f28bde4f13f2200408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a126de-9a", "ovs_interfaceid": "08a126de-9aff-4def-baa5-0401181a8d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:61:ec,bridge_name='br-int',has_traffic_filtering=True,id=08a126de-9aff-4def-baa5-0401181a8d3b,network=Network(5f60f46f-086a-4008-a28e-a5aee728a59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a126de-9a') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG os_vif [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:61:ec,bridge_name='br-int',has_traffic_filtering=True,id=08a126de-9aff-4def-baa5-0401181a8d3b,network=Network(5f60f46f-086a-4008-a28e-a5aee728a59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a126de-9a') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08a126de-9a, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:43:04 user nova-compute[70374]: INFO os_vif [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:61:ec,bridge_name='br-int',has_traffic_filtering=True,id=08a126de-9aff-4def-baa5-0401181a8d3b,network=Network(5f60f46f-086a-4008-a28e-a5aee728a59e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a126de-9a')
Jul 27 09:43:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Deleting instance files /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9_del
Jul 27 09:43:04 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Deletion of /opt/stack/data/nova/instances/69a59942-cd83-4f74-82ea-f23a6538cef9_del complete
Jul 27 09:43:04 user nova-compute[70374]: INFO nova.compute.manager [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 09:43:04 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:43:04 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:43:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:05 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:43:05 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Took 0.82 seconds to deallocate network for instance.
Jul 27 09:43:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:06 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:43:06 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:43:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:06 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Deleted allocations for instance 69a59942-cd83-4f74-82ea-f23a6538cef9
Jul 27 09:43:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d8b1dbfd-6756-4549-9b8b-d8e892cc3ef9 tempest-ServerStableDeviceRescueTest-1292987631 tempest-ServerStableDeviceRescueTest-1292987631-project-member] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.331s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-2b9efe0a-41ed-4abd-8455-8248ed6d3d41 req-0fa4d9a0-ac3a-4060-9a66-c88cd7e1f02d service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b9efe0a-41ed-4abd-8455-8248ed6d3d41 req-0fa4d9a0-ac3a-4060-9a66-c88cd7e1f02d service nova] Acquiring lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b9efe0a-41ed-4abd-8455-8248ed6d3d41 req-0fa4d9a0-ac3a-4060-9a66-c88cd7e1f02d service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b9efe0a-41ed-4abd-8455-8248ed6d3d41 req-0fa4d9a0-ac3a-4060-9a66-c88cd7e1f02d service nova] Lock "69a59942-cd83-4f74-82ea-f23a6538cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-2b9efe0a-41ed-4abd-8455-8248ed6d3d41 req-0fa4d9a0-ac3a-4060-9a66-c88cd7e1f02d service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] No waiting events found dispatching network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:06 user nova-compute[70374]: WARNING nova.compute.manager [req-2b9efe0a-41ed-4abd-8455-8248ed6d3d41 req-0fa4d9a0-ac3a-4060-9a66-c88cd7e1f02d service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received unexpected event network-vif-plugged-08a126de-9aff-4def-baa5-0401181a8d3b for instance with vm_state deleted and task_state None.
Jul 27 09:43:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-2b9efe0a-41ed-4abd-8455-8248ed6d3d41 req-0fa4d9a0-ac3a-4060-9a66-c88cd7e1f02d service nova] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Received event network-vif-deleted-08a126de-9aff-4def-baa5-0401181a8d3b {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-bb7d5d19-9664-4b62-9c9e-c10601fc44fa req-0ecdbd36-63b1-4a72-9f19-c3658ce88183 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-changed-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-bb7d5d19-9664-4b62-9c9e-c10601fc44fa req-0ecdbd36-63b1-4a72-9f19-c3658ce88183 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Refreshing instance network info cache due to event network-changed-dfa2198f-6276-43cd-8b58-8281d4424143. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:43:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bb7d5d19-9664-4b62-9c9e-c10601fc44fa req-0ecdbd36-63b1-4a72-9f19-c3658ce88183 service nova] Acquiring lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:43:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bb7d5d19-9664-4b62-9c9e-c10601fc44fa req-0ecdbd36-63b1-4a72-9f19-c3658ce88183 service nova] Acquired lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:43:09 user nova-compute[70374]: DEBUG nova.network.neutron [req-bb7d5d19-9664-4b62-9c9e-c10601fc44fa req-0ecdbd36-63b1-4a72-9f19-c3658ce88183 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Refreshing network info cache for port dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG nova.network.neutron [req-bb7d5d19-9664-4b62-9c9e-c10601fc44fa req-0ecdbd36-63b1-4a72-9f19-c3658ce88183 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updated VIF entry in instance network info cache for port dfa2198f-6276-43cd-8b58-8281d4424143. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG nova.network.neutron [req-bb7d5d19-9664-4b62-9c9e-c10601fc44fa req-0ecdbd36-63b1-4a72-9f19-c3658ce88183 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating instance_info_cache with network_info: [{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bb7d5d19-9664-4b62-9c9e-c10601fc44fa req-0ecdbd36-63b1-4a72-9f19-c3658ce88183 service nova] Releasing lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqSOcKmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:43:10 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:43:10 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:43:10 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d628b3-b2ae-45e6-a32b-a05e67c88016]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:43:10 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fda9cdb-8d91-4b4c-ba9e-960eb47c0751]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925] added
Jul 27 09:43:10 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[26075d9e-9cac-4465-88c7-8c5a10cdf397]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65d771a-ecb4-4adb-83a3-149eebadb1ad]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqSOcKmx {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqSOcKmx" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2d32df-8118-4ea9-989b-639109bc8b39]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IqSOcKmx'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a88241-447e-410d-9bcd-c5c6e1bec0e1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:10 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ec2c7-3c0c-4895-a343-8a0ba1be98db]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)
Jul 27 09:43:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)
Jul 27 09:43:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fae9519-8b1a-47d5-8a23-55966fc7334b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925, portal: 172.16.0.220,3260]
Jul 27 09:43:11 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925, portal: 172.16.0.220,3260] successful.
Jul 27 09:43:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acabcff-3a33-4d1e-94a7-7f5943609a35]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ef940-2541-4fbf-915a-994df585b7b4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)
Jul 27 09:43:11 user nova-compute[70374]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)
Jul 27 09:43:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84d825-9528-446a-8deb-d4e94698e2fb]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:43:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqSOcKmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26363646162653235', 'path': '/dev/sde'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363646162653235', 'path': '/dev/sde'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:43:12 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:43:12 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:43:12 user nova-compute[70374]:   <target dev="vdc" bus="virtio"/>
Jul 27 09:43:12 user nova-compute[70374]:   <serial>34b2885c-005c-42b8-b0e5-56c52edf9925</serial>
Jul 27 09:43:12 user nova-compute[70374]: </disk>
Jul 27 09:43:12 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] No VIF found with MAC fa:16:3e:6a:d7:9f, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:43:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4a851e6a-0079-451a-b4ef-9cac246fe099 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.095s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:13 user nova-compute[70374]: INFO nova.compute.manager [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Shelving
Jul 27 09:43:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-d5391ca1-b995-4a0e-b77f-1b3d75a8c26d req-acd176c8-edab-4d2e-8371-38bc12f489dc service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-unplugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d5391ca1-b995-4a0e-b77f-1b3d75a8c26d req-acd176c8-edab-4d2e-8371-38bc12f489dc service nova] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d5391ca1-b995-4a0e-b77f-1b3d75a8c26d req-acd176c8-edab-4d2e-8371-38bc12f489dc service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d5391ca1-b995-4a0e-b77f-1b3d75a8c26d req-acd176c8-edab-4d2e-8371-38bc12f489dc service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-d5391ca1-b995-4a0e-b77f-1b3d75a8c26d req-acd176c8-edab-4d2e-8371-38bc12f489dc service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] No waiting events found dispatching network-vif-unplugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:13 user nova-compute[70374]: WARNING nova.compute.manager [req-d5391ca1-b995-4a0e-b77f-1b3d75a8c26d req-acd176c8-edab-4d2e-8371-38bc12f489dc service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received unexpected event network-vif-unplugged-dfa2198f-6276-43cd-8b58-8281d4424143 for instance with vm_state active and task_state shelving.
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:14 user nova-compute[70374]: INFO nova.compute.manager [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Detaching volume ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae
Jul 27 09:43:14 user nova-compute[70374]: INFO nova.virt.block_device [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Attempting to driver detach volume ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae from mountpoint /dev/vdb
Jul 27 09:43:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Attempting to detach device vdb from instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:43:14 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:43:14 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:43:14 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:43:14 user nova-compute[70374]:   <serial>ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae</serial>
Jul 27 09:43:14 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:43:14 user nova-compute[70374]: </disk>
Jul 27 09:43:14 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:14 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully detached device vdb from instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 from the persistent domain config.
Jul 27 09:43:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:43:14 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:43:14 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:43:14 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:43:14 user nova-compute[70374]:   <serial>ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae</serial>
Jul 27 09:43:14 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:43:14 user nova-compute[70374]: </disk>
Jul 27 09:43:14 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:43:14 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance destroyed successfully.
Jul 27 09:43:14 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Beginning cold snapshot process
Jul 27 09:43:14 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk /opt/stack/data/nova/instances/snapshots/tmpledez24o/18f0d9f9e36c490c990d181c3e9d97cb {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450994.754426, 209af1ec-b5cb-491c-9854-8ff3a8b31b13 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:43:14 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully detached device vdb from instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 from the live domain config.
Jul 27 09:43:14 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSzPlHey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:43:14 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aadd8a-1620-4d1a-82b3-01527bf44a58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:43:14 user nova-compute[70374]: No targets found.
Jul 27 09:43:14 user nova-compute[70374]: iSNS:
Jul 27 09:43:14 user nova-compute[70374]: No targets found.
Jul 27 09:43:14 user nova-compute[70374]: STATIC:
Jul 27 09:43:14 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925
Jul 27 09:43:14 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:43:14 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:43:14 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:43:14 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:43:14 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:43:14 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae
Jul 27 09:43:14 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:43:14 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:43:14 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:43:14 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:43:14 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:43:14 user nova-compute[70374]: FIRMWARE:
Jul 27 09:43:14 user nova-compute[70374]: No targets found.
Jul 27 09:43:14 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:43:14 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:43:14 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f84518d-4860-4a8f-814c-63f7ff3dd80c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[689b6d87-28d1-4aed-bcae-0016eaf9d6cf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:43:14 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:43:14 user nova-compute[70374]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)
Jul 27 09:43:14 user nova-compute[70374]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)
Jul 27 09:43:14 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:43:14 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:43:14 user nova-compute[70374]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae (non-flash)
Jul 27 09:43:14 user nova-compute[70374]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)
Jul 27 09:43:14 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280b9ac310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe06fc4-80ab-4ecf-aa17-c34cc858801c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd17aa-49ec-4c12-8e5d-613fb5915476]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6cd23a-d557-4ffd-884e-568a8a598376]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.087s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a8967c-8f28-4d24-b086-ebdf9cb7b414]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:43:14 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c4a183-f917-444f-b6f3-1ca80083eb39]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29de8d4-2944-41da-94ef-d4c5823fa809]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae, portal: 172.16.0.220,3260]
Jul 27 09:43:15 user nova-compute[70374]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae, portal: 172.16.0.220,3260] successful.
Jul 27 09:43:15 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ede1ab4e-a6bd-4023-a83b-e0d0e1f7aaae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[95daae39-b95e-4a67-b5cf-f83f689a5788]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== disconnect_volume: return (408ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk /opt/stack/data/nova/instances/snapshots/tmpledez24o/18f0d9f9e36c490c990d181c3e9d97cb" returned: 0 in 0.813s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:15 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Snapshot extracted, beginning image upload
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-6ecbf0ba-a5fe-49e0-a8bf-db7d0c213032 req-05df4cfe-48f8-4330-b383-76c71f8b1a10 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6ecbf0ba-a5fe-49e0-a8bf-db7d0c213032 req-05df4cfe-48f8-4330-b383-76c71f8b1a10 service nova] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6ecbf0ba-a5fe-49e0-a8bf-db7d0c213032 req-05df4cfe-48f8-4330-b383-76c71f8b1a10 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6ecbf0ba-a5fe-49e0-a8bf-db7d0c213032 req-05df4cfe-48f8-4330-b383-76c71f8b1a10 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-6ecbf0ba-a5fe-49e0-a8bf-db7d0c213032 req-05df4cfe-48f8-4330-b383-76c71f8b1a10 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] No waiting events found dispatching network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:15 user nova-compute[70374]: WARNING nova.compute.manager [req-6ecbf0ba-a5fe-49e0-a8bf-db7d0c213032 req-05df4cfe-48f8-4330-b383-76c71f8b1a10 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received unexpected event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 for instance with vm_state active and task_state shelving_image_uploading.
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG nova.objects.instance [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-692ac27c-f0f5-4a9d-a8e8-2801664a01af tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.926s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:16 user nova-compute[70374]: INFO nova.compute.manager [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Detaching volume 34b2885c-005c-42b8-b0e5-56c52edf9925
Jul 27 09:43:16 user nova-compute[70374]: INFO nova.virt.block_device [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Attempting to driver detach volume 34b2885c-005c-42b8-b0e5-56c52edf9925 from mountpoint /dev/vdc
Jul 27 09:43:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Attempting to detach device vdc from instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:43:16 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:43:16 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:43:16 user nova-compute[70374]:   <target dev="vdc" bus="virtio"/>
Jul 27 09:43:16 user nova-compute[70374]:   <serial>34b2885c-005c-42b8-b0e5-56c52edf9925</serial>
Jul 27 09:43:16 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 09:43:16 user nova-compute[70374]: </disk>
Jul 27 09:43:16 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:16 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully detached device vdc from instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 from the persistent domain config.
Jul 27 09:43:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:43:16 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:43:16 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:43:16 user nova-compute[70374]:   <target dev="vdc" bus="virtio"/>
Jul 27 09:43:16 user nova-compute[70374]:   <serial>34b2885c-005c-42b8-b0e5-56c52edf9925</serial>
Jul 27 09:43:16 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 09:43:16 user nova-compute[70374]: </disk>
Jul 27 09:43:16 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690450997.2507973, 209af1ec-b5cb-491c-9854-8ff3a8b31b13 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:43:17 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully detached device vdc from instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 from the live domain config.
Jul 27 09:43:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqSOcKmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:43:17 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe67c6f6-c058-435c-9380-5f365a0c32a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:43:17 user nova-compute[70374]: No targets found.
Jul 27 09:43:17 user nova-compute[70374]: iSNS:
Jul 27 09:43:17 user nova-compute[70374]: No targets found.
Jul 27 09:43:17 user nova-compute[70374]: STATIC:
Jul 27 09:43:17 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925
Jul 27 09:43:17 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:43:17 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:43:17 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:43:17 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:43:17 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:43:17 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:43:17 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:43:17 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:43:17 user nova-compute[70374]: FIRMWARE:
Jul 27 09:43:17 user nova-compute[70374]: No targets found.
Jul 27 09:43:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:43:17 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:43:17 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5d71a4-e798-45f6-905e-5839a5ba8175]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0afd5e1-ab85-4116-871c-8c1a37bf19c8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:43:17 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:43:17 user nova-compute[70374]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)
Jul 27 09:43:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:43:17 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:43:17 user nova-compute[70374]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 (non-flash)
Jul 27 09:43:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280b9af0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925'): ({'sde'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Removing single pathed devices sde {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc060b46-57b0-4380-9191-1f8ca9f09182]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ea7c18-46a1-4b62-bc66-0fe55b74a01f]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Flushing IO for device /dev/sde {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6ea8df-9a41-4728-b4f0-a3422c462e30]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3463743-f8f5-429d-b2f0-37812db153fc]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4378d63-87ee-4732-8317-0dcc0199dcf2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc88fe8-3699-490d-af4d-014d1c5491fa]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925, portal: 172.16.0.220,3260]
Jul 27 09:43:17 user nova-compute[70374]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925, portal: 172.16.0.220,3260] successful.
Jul 27 09:43:17 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b2885c-005c-42b8-b0e5-56c52edf9925 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a61b06a-7f09-4b35-a298-226e8b45cfef]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] <== disconnect_volume: return (393ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:17 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Snapshot image upload complete
Jul 27 09:43:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:18 user nova-compute[70374]: INFO nova.compute.manager [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Shelve offloading
Jul 27 09:43:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance destroyed successfully.
Jul 27 09:43:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquired lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'flavor' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-37790172-bf3a-480a-8937-5234a5a05972 tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.812s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:43:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating instance_info_cache with network_info: [{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:43:19 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:43:19 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=25.376293182373047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Releasing lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:19 user nova-compute[70374]: INFO nova.compute.manager [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Terminating instance
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 66911d11-4025-4243-9f8e-ff0909460190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 38e29c83-3067-492a-9b4c-953f5344ba2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 56ab07d0-823d-4282-bdc5-21910c33678a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450984.6847322, 69a59942-cd83-4f74-82ea-f23a6538cef9 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:43:19 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] VM Stopped (Lifecycle Event)
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-951946f6-99e5-464b-ab68-25728f0f772b None None] [instance: 69a59942-cd83-4f74-82ea-f23a6538cef9] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-c4923bbe-1ecb-409a-b7fd-c2669acb1ee9 req-2825ce40-0e20-494a-a545-b385c94ad081 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-vif-unplugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c4923bbe-1ecb-409a-b7fd-c2669acb1ee9 req-2825ce40-0e20-494a-a545-b385c94ad081 service nova] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c4923bbe-1ecb-409a-b7fd-c2669acb1ee9 req-2825ce40-0e20-494a-a545-b385c94ad081 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c4923bbe-1ecb-409a-b7fd-c2669acb1ee9 req-2825ce40-0e20-494a-a545-b385c94ad081 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-c4923bbe-1ecb-409a-b7fd-c2669acb1ee9 req-2825ce40-0e20-494a-a545-b385c94ad081 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] No waiting events found dispatching network-vif-unplugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-c4923bbe-1ecb-409a-b7fd-c2669acb1ee9 req-2825ce40-0e20-494a-a545-b385c94ad081 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-vif-unplugged-db247eac-602c-4249-9473-94ee4a0dcfea for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Instance destroyed successfully.
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lazy-loading 'resources' on Instance uuid 209af1ec-b5cb-491c-9854-8ff3a8b31b13 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-863353107',display_name='tempest-AttachVolumeTestJSON-server-863353107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-863353107',id=29,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIokJtVSvVLGcA2wpNLNfzVkxUnqdOhFZ2EgU8IKKAy7suSu5KP+LCEGnOEYnqO35QKNjdPDSdgYMN4onb1pLB3ww92gNiJEiYQF6vJ/uASdbo6Ns+VgQ8LJ3+HxD5uJTw==',key_name='tempest-keypair-2066385099',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0592f0be670742a181e24823955f378b',ramdisk_id='',reservation_id='r-04fy0zqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847846253',owner_user_name='tempest-AttachVolumeTestJSON-847846253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d4c5ec795ee4d3387ce8718d2ac67e0',uuid=209af1ec-b5cb-491c-9854-8ff3a8b31b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converting VIF {"id": "db247eac-602c-4249-9473-94ee4a0dcfea", "address": "fa:16:3e:6a:d7:9f", "network": {"id": "b51b0e60-de31-47a5-908f-36f76e9fa620", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-754390872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0592f0be670742a181e24823955f378b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb247eac-60", "ovs_interfaceid": "db247eac-602c-4249-9473-94ee4a0dcfea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=db247eac-602c-4249-9473-94ee4a0dcfea,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb247eac-60') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG os_vif [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=db247eac-602c-4249-9473-94ee4a0dcfea,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb247eac-60') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb247eac-60, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: INFO os_vif [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d7:9f,bridge_name='br-int',has_traffic_filtering=True,id=db247eac-602c-4249-9473-94ee4a0dcfea,network=Network(b51b0e60-de31-47a5-908f-36f76e9fa620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb247eac-60')
Jul 27 09:43:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Deleting instance files /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13_del
Jul 27 09:43:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Deletion of /opt/stack/data/nova/instances/209af1ec-b5cb-491c-9854-8ff3a8b31b13_del complete
Jul 27 09:43:20 user nova-compute[70374]: INFO nova.compute.manager [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 09:43:20 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance destroyed successfully.
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'resources' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038229673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1038229673',id=30,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOggog+sD4MFx0TWo+CfaL3x6gHI0VGarfQSfGQ3rWq08Yysx0zbtwW7ER+CAZlTK2NE1UVnxPc+lt5QyNYC4qOg/idV3sz+RgkLh8GySrbyoOyjcG2gias3K2Jazhaw+w==',key_name='tempest-keypair-1092477681',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-1ws0fl1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member',shelved_at='2023-07-27T09:43:18.000030',shelved_host='user',shelved_image_id='9d98afe4-f2cd-4311-ac89-8176d5f691d7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=56ab07d0-823d-4282-bdc5-21910c33678a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG os_vif [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfa2198f-62, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:20 user nova-compute[70374]: INFO os_vif [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62')
Jul 27 09:43:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Deleting instance files /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a_del
Jul 27 09:43:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Deletion of /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a_del complete
Jul 27 09:43:20 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Deleted allocations for instance 56ab07d0-823d-4282-bdc5-21910c33678a
Jul 27 09:43:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'numa_topology' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d7e317a-d899-4aea-818f-533298343ba2 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.771s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:43:21 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Took 1.34 seconds to deallocate network for instance.
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] No waiting events found dispatching network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:21 user nova-compute[70374]: WARNING nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received unexpected event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea for instance with vm_state deleted and task_state None.
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] No waiting events found dispatching network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:21 user nova-compute[70374]: WARNING nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received unexpected event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea for instance with vm_state deleted and task_state None.
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Acquiring lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] No waiting events found dispatching network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:21 user nova-compute[70374]: WARNING nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received unexpected event network-vif-plugged-db247eac-602c-4249-9473-94ee4a0dcfea for instance with vm_state deleted and task_state None.
Jul 27 09:43:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba2e1aeb-30a7-4974-9295-919e8de08914 req-f1e33143-8d8d-4516-a006-4ad727f37bf2 service nova] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Received event network-vif-deleted-db247eac-602c-4249-9473-94ee4a0dcfea {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:21 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Deleted allocations for instance 209af1ec-b5cb-491c-9854-8ff3a8b31b13
Jul 27 09:43:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d208509f-615a-46d5-b68b-7b289f9639cf tempest-AttachVolumeTestJSON-847846253 tempest-AttachVolumeTestJSON-847846253-project-member] Lock "209af1ec-b5cb-491c-9854-8ff3a8b31b13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.811s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:29 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450994.356467, 56ab07d0-823d-4282-bdc5-21910c33678a => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:43:29 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] VM Stopped (Lifecycle Event)
Jul 27 09:43:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e6ce685b-4694-4b77-86bd-8a3655a10e09 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:43:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:34 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690450999.9846659, 209af1ec-b5cb-491c-9854-8ff3a8b31b13 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:43:34 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] VM Stopped (Lifecycle Event)
Jul 27 09:43:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2a054970-544b-444d-9b38-22df3c1168dc None None] [instance: 209af1ec-b5cb-491c-9854-8ff3a8b31b13] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:43:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:43:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:45 user nova-compute[70374]: INFO nova.compute.manager [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Terminating instance
Jul 27 09:43:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-091a7f96-79a8-42b5-bcb9-48a356bcb882 req-21d2a5c3-df93-4d59-ae84-25d1afa586be service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received event network-vif-unplugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-091a7f96-79a8-42b5-bcb9-48a356bcb882 req-21d2a5c3-df93-4d59-ae84-25d1afa586be service nova] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-091a7f96-79a8-42b5-bcb9-48a356bcb882 req-21d2a5c3-df93-4d59-ae84-25d1afa586be service nova] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-091a7f96-79a8-42b5-bcb9-48a356bcb882 req-21d2a5c3-df93-4d59-ae84-25d1afa586be service nova] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-091a7f96-79a8-42b5-bcb9-48a356bcb882 req-21d2a5c3-df93-4d59-ae84-25d1afa586be service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] No waiting events found dispatching network-vif-unplugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-091a7f96-79a8-42b5-bcb9-48a356bcb882 req-21d2a5c3-df93-4d59-ae84-25d1afa586be service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received event network-vif-unplugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:43:46 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Instance destroyed successfully.
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lazy-loading 'resources' on Instance uuid 38e29c83-3067-492a-9b4c-953f5344ba2a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-54880262',display_name='tempest-AttachVolumeNegativeTest-server-54880262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-54880262',id=28,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxydFxQntbmTuUdQYD1Xo27+bgVUXwgIBmPkoHTQLikz9TupV1eXN+VwwU1N9ducgIvEOTYpiao4N4Bhqbe6KM/p9HYZ+d2by0aWc2RUevQ77SF29HkGqN5t2FlJ0vsaw==',key_name='tempest-keypair-358103055',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:40:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfaa69b3745a435795aa636ccddec3af',ramdisk_id='',reservation_id='r-ahqymeam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-305502590',owner_user_name='tempest-AttachVolumeNegativeTest-305502590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:40:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c1d49c23b0045d881d9f47e33447162',uuid=38e29c83-3067-492a-9b4c-953f5344ba2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converting VIF {"id": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "address": "fa:16:3e:bb:36:72", "network": {"id": "fb617df7-46b2-48ba-beb1-29eefa43aa47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-96492016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfaa69b3745a435795aa636ccddec3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b57f91-ad", "ovs_interfaceid": "e9b57f91-ad8d-4146-a6e4-9138309aa071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:36:72,bridge_name='br-int',has_traffic_filtering=True,id=e9b57f91-ad8d-4146-a6e4-9138309aa071,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b57f91-ad') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG os_vif [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:36:72,bridge_name='br-int',has_traffic_filtering=True,id=e9b57f91-ad8d-4146-a6e4-9138309aa071,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b57f91-ad') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b57f91-ad, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:43:46 user nova-compute[70374]: INFO os_vif [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:36:72,bridge_name='br-int',has_traffic_filtering=True,id=e9b57f91-ad8d-4146-a6e4-9138309aa071,network=Network(fb617df7-46b2-48ba-beb1-29eefa43aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b57f91-ad')
Jul 27 09:43:46 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Deleting instance files /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a_del
Jul 27 09:43:46 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Deletion of /opt/stack/data/nova/instances/38e29c83-3067-492a-9b4c-953f5344ba2a_del complete
Jul 27 09:43:46 user nova-compute[70374]: INFO nova.compute.manager [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 27 09:43:46 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:43:46 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:43:47 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:43:47 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Took 0.72 seconds to deallocate network for instance.
Jul 27 09:43:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-7dcdff57-4708-4437-8499-d427c34caf74 req-67daa27f-8bdb-452b-9867-4a8557e514dd service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received event network-vif-deleted-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:47 user nova-compute[70374]: INFO nova.compute.manager [req-7dcdff57-4708-4437-8499-d427c34caf74 req-67daa27f-8bdb-452b-9867-4a8557e514dd service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Neutron deleted interface e9b57f91-ad8d-4146-a6e4-9138309aa071; detaching it from the instance and deleting it from the info cache
Jul 27 09:43:47 user nova-compute[70374]: DEBUG nova.network.neutron [req-7dcdff57-4708-4437-8499-d427c34caf74 req-67daa27f-8bdb-452b-9867-4a8557e514dd service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:43:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-7dcdff57-4708-4437-8499-d427c34caf74 req-67daa27f-8bdb-452b-9867-4a8557e514dd service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Detach interface failed, port_id=e9b57f91-ad8d-4146-a6e4-9138309aa071, reason: Instance 38e29c83-3067-492a-9b4c-953f5344ba2a could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:43:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:47 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:43:47 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:43:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:47 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Deleted allocations for instance 38e29c83-3067-492a-9b4c-953f5344ba2a
Jul 27 09:43:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9d98b60c-30b8-4bd1-b138-c25b4e7d1707 tempest-AttachVolumeNegativeTest-305502590 tempest-AttachVolumeNegativeTest-305502590-project-member] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-9295aa33-8edb-41d8-ac17-e7c37b8bc8be req-2d8d5b47-d113-43c8-8df3-592c600f6db3 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received event network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9295aa33-8edb-41d8-ac17-e7c37b8bc8be req-2d8d5b47-d113-43c8-8df3-592c600f6db3 service nova] Acquiring lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:43:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9295aa33-8edb-41d8-ac17-e7c37b8bc8be req-2d8d5b47-d113-43c8-8df3-592c600f6db3 service nova] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:43:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9295aa33-8edb-41d8-ac17-e7c37b8bc8be req-2d8d5b47-d113-43c8-8df3-592c600f6db3 service nova] Lock "38e29c83-3067-492a-9b4c-953f5344ba2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:43:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-9295aa33-8edb-41d8-ac17-e7c37b8bc8be req-2d8d5b47-d113-43c8-8df3-592c600f6db3 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] No waiting events found dispatching network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:43:48 user nova-compute[70374]: WARNING nova.compute.manager [req-9295aa33-8edb-41d8-ac17-e7c37b8bc8be req-2d8d5b47-d113-43c8-8df3-592c600f6db3 service nova] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Received unexpected event network-vif-plugged-e9b57f91-ad8d-4146-a6e4-9138309aa071 for instance with vm_state deleted and task_state None.
Jul 27 09:43:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:43:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-023c1cf4-57fd-4f33-b120-911604ee3cb2 req-1517576e-4256-48ee-bdae-8bfc71b67c99 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-changed-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:43:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-023c1cf4-57fd-4f33-b120-911604ee3cb2 req-1517576e-4256-48ee-bdae-8bfc71b67c99 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Refreshing instance network info cache due to event network-changed-ad798508-8253-45fd-874b-abfa6dc1b966. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:43:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-023c1cf4-57fd-4f33-b120-911604ee3cb2 req-1517576e-4256-48ee-bdae-8bfc71b67c99 service nova] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:43:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-023c1cf4-57fd-4f33-b120-911604ee3cb2 req-1517576e-4256-48ee-bdae-8bfc71b67c99 service nova] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:43:59 user nova-compute[70374]: DEBUG nova.network.neutron [req-023c1cf4-57fd-4f33-b120-911604ee3cb2 req-1517576e-4256-48ee-bdae-8bfc71b67c99 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Refreshing network info cache for port ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:44:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:00 user nova-compute[70374]: DEBUG nova.network.neutron [req-023c1cf4-57fd-4f33-b120-911604ee3cb2 req-1517576e-4256-48ee-bdae-8bfc71b67c99 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updated VIF entry in instance network info cache for port ad798508-8253-45fd-874b-abfa6dc1b966. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:44:00 user nova-compute[70374]: DEBUG nova.network.neutron [req-023c1cf4-57fd-4f33-b120-911604ee3cb2 req-1517576e-4256-48ee-bdae-8bfc71b67c99 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:44:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-023c1cf4-57fd-4f33-b120-911604ee3cb2 req-1517576e-4256-48ee-bdae-8bfc71b67c99 service nova] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:44:01 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451026.5745003, 38e29c83-3067-492a-9b4c-953f5344ba2a => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:44:01 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] VM Stopped (Lifecycle Event)
Jul 27 09:44:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-03ff8e85-4cc9-4699-9623-62dd5a67db97 None None] [instance: 38e29c83-3067-492a-9b4c-953f5344ba2a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:44:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:44:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [{"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-fb5ccac9-1e45-4726-b681-cf34cf3fa521" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:44:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:44:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:16 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:16 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:20 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:44:20 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8009MB free_disk=25.454784393310547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 66911d11-4025-4243-9f8e-ff0909460190 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:44:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:44:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:44:23 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:23 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:44:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-915025b4-37ba-4863-a876-77678e324cf3 req-895ef299-08ea-438d-be30-2d8843429995 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-changed-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-915025b4-37ba-4863-a876-77678e324cf3 req-895ef299-08ea-438d-be30-2d8843429995 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Refreshing instance network info cache due to event network-changed-c5e7d75d-7b90-4a67-a548-f829c290e294. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-915025b4-37ba-4863-a876-77678e324cf3 req-895ef299-08ea-438d-be30-2d8843429995 service nova] Acquiring lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-915025b4-37ba-4863-a876-77678e324cf3 req-895ef299-08ea-438d-be30-2d8843429995 service nova] Acquired lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-915025b4-37ba-4863-a876-77678e324cf3 req-895ef299-08ea-438d-be30-2d8843429995 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Refreshing network info cache for port c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-915025b4-37ba-4863-a876-77678e324cf3 req-895ef299-08ea-438d-be30-2d8843429995 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updated VIF entry in instance network info cache for port c5e7d75d-7b90-4a67-a548-f829c290e294. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-915025b4-37ba-4863-a876-77678e324cf3 req-895ef299-08ea-438d-be30-2d8843429995 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-915025b4-37ba-4863-a876-77678e324cf3 req-895ef299-08ea-438d-be30-2d8843429995 service nova] Releasing lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:44:33 user nova-compute[70374]: INFO nova.compute.manager [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Detaching volume e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:44:33 user nova-compute[70374]: INFO nova.virt.block_device [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Attempting to driver detach volume e596a883-20cb-4fe1-ad7c-5999f23ba940 from mountpoint /dev/vdb
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Attempting to detach device vdb from instance 66911d11-4025-4243-9f8e-ff0909460190 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:44:33 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:44:33 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:44:33 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:44:33 user nova-compute[70374]:   <serial>e596a883-20cb-4fe1-ad7c-5999f23ba940</serial>
Jul 27 09:44:33 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:44:33 user nova-compute[70374]: </disk>
Jul 27 09:44:33 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:44:33 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Successfully detached device vdb from instance 66911d11-4025-4243-9f8e-ff0909460190 from the persistent domain config.
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 66911d11-4025-4243-9f8e-ff0909460190 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:44:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:44:33 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:44:33 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:44:33 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:44:33 user nova-compute[70374]:   <serial>e596a883-20cb-4fe1-ad7c-5999f23ba940</serial>
Jul 27 09:44:33 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:44:33 user nova-compute[70374]: </disk>
Jul 27 09:44:33 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451074.1063764, 66911d11-4025-4243-9f8e-ff0909460190 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:44:34 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Successfully detached device vdb from instance 66911d11-4025-4243-9f8e-ff0909460190 from the live domain config.
Jul 27 09:44:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXxBSjJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:44:34 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5225a57-1abe-47ea-832a-331a80e1dcc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:44:34 user nova-compute[70374]: No targets found.
Jul 27 09:44:34 user nova-compute[70374]: iSNS:
Jul 27 09:44:34 user nova-compute[70374]: No targets found.
Jul 27 09:44:34 user nova-compute[70374]: STATIC:
Jul 27 09:44:34 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:44:34 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:44:34 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:44:34 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940
Jul 27 09:44:34 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:44:34 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:44:34 user nova-compute[70374]: FIRMWARE:
Jul 27 09:44:34 user nova-compute[70374]: No targets found.
Jul 27 09:44:34 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:44:34 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:44:34 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e21609e-e5d4-4fe8-9aac-75bd3ade7827]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20533db-bde5-4524-bf05-f1dddd970783]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:44:34 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:44:34 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 (non-flash)
Jul 27 09:44:34 user nova-compute[70374]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:44:34 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28005641f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3daf42-1f3b-410c-b582-ae286b736252]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafcf47a-95e7-46dc-9492-23d711080ae8]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cd5fae-225c-486a-92c6-46dad38c002d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1c4ae3-456f-4dc7-931f-c8c7758dc903]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead8c0eb-aa43-4e3c-93cd-13b95e7b2748]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1620de5-e81e-4ec9-9b5b-9b75ed13ad2f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940, portal: 172.16.0.220,3260]
Jul 27 09:44:34 user nova-compute[70374]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940, portal: 172.16.0.220,3260] successful.
Jul 27 09:44:34 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e596a883-20cb-4fe1-ad7c-5999f23ba940 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53028f5-d52e-42cc-a579-127c3ebc3378]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] <== disconnect_volume: return (322ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:44:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c7cf6bf6-1b2c-4a63-bf12-8d40bcef1b73 req-9d7135b2-b0e6-40b5-b889-3091d1ddb5b6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-changed-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c7cf6bf6-1b2c-4a63-bf12-8d40bcef1b73 req-9d7135b2-b0e6-40b5-b889-3091d1ddb5b6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Refreshing instance network info cache due to event network-changed-c5e7d75d-7b90-4a67-a548-f829c290e294. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c7cf6bf6-1b2c-4a63-bf12-8d40bcef1b73 req-9d7135b2-b0e6-40b5-b889-3091d1ddb5b6 service nova] Acquiring lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c7cf6bf6-1b2c-4a63-bf12-8d40bcef1b73 req-9d7135b2-b0e6-40b5-b889-3091d1ddb5b6 service nova] Acquired lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-c7cf6bf6-1b2c-4a63-bf12-8d40bcef1b73 req-9d7135b2-b0e6-40b5-b889-3091d1ddb5b6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Refreshing network info cache for port c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG nova.objects.instance [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'flavor' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-76a8e7fe-af7e-4f92-87e6-fe660972a72c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.691s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-c7cf6bf6-1b2c-4a63-bf12-8d40bcef1b73 req-9d7135b2-b0e6-40b5-b889-3091d1ddb5b6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updated VIF entry in instance network info cache for port c5e7d75d-7b90-4a67-a548-f829c290e294. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-c7cf6bf6-1b2c-4a63-bf12-8d40bcef1b73 req-9d7135b2-b0e6-40b5-b889-3091d1ddb5b6 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [{"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:44:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c7cf6bf6-1b2c-4a63-bf12-8d40bcef1b73 req-9d7135b2-b0e6-40b5-b889-3091d1ddb5b6 service nova] Releasing lock "refresh_cache-66911d11-4025-4243-9f8e-ff0909460190" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-89887f96-9fc4-497c-973c-3f193359f8a4 req-dc9ecdb2-9fd0-4942-878a-af91e69d1d2c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received event network-changed-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-89887f96-9fc4-497c-973c-3f193359f8a4 req-dc9ecdb2-9fd0-4942-878a-af91e69d1d2c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Refreshing instance network info cache due to event network-changed-10f91912-fc13-4fb8-a5eb-a47f17b5e749. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-89887f96-9fc4-497c-973c-3f193359f8a4 req-dc9ecdb2-9fd0-4942-878a-af91e69d1d2c service nova] Acquiring lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-89887f96-9fc4-497c-973c-3f193359f8a4 req-dc9ecdb2-9fd0-4942-878a-af91e69d1d2c service nova] Acquired lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG nova.network.neutron [req-89887f96-9fc4-497c-973c-3f193359f8a4 req-dc9ecdb2-9fd0-4942-878a-af91e69d1d2c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Refreshing network info cache for port 10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:44:36 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'flavor' on Instance uuid 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:44:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Ignoring supplied device name: /dev/vdb
Jul 27 09:44:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:44:37 user nova-compute[70374]: INFO nova.compute.manager [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Attaching volume d09e54a4-23fc-41ed-8697-d06fac206aa7 to /dev/vdb
Jul 27 09:44:37 user nova-compute[70374]: DEBUG os_brick.utils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf97e425-7bbc-4299-b60c-6f2a16588db8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5870159-53b3-4412-8c8e-78581f9dba93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5192dd-3d7e-4a00-ad08-b5f50c786de2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e758490-ddd6-4af1-9e45-a499f3e0db54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:44:37 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc479919-0bba-4e4b-9fe8-bc8c5052938c]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG os_brick.utils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Updating existing volume attachment record: 8ec22cbd-10d1-4103-a770-bca1ec936d0b {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG nova.network.neutron [req-89887f96-9fc4-497c-973c-3f193359f8a4 req-dc9ecdb2-9fd0-4942-878a-af91e69d1d2c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Updated VIF entry in instance network info cache for port 10f91912-fc13-4fb8-a5eb-a47f17b5e749. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG nova.network.neutron [req-89887f96-9fc4-497c-973c-3f193359f8a4 req-dc9ecdb2-9fd0-4942-878a-af91e69d1d2c service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Updating instance_info_cache with network_info: [{"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:44:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-89887f96-9fc4-497c-973c-3f193359f8a4 req-dc9ecdb2-9fd0-4942-878a-af91e69d1d2c service nova] Releasing lock "refresh_cache-1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:44:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:44:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:44:41 user nova-compute[70374]: INFO nova.compute.manager [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Detaching volume d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:44:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:41 user nova-compute[70374]: INFO nova.virt.block_device [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Attempting to driver detach volume d85fc96b-076c-4399-a10f-a6468bb76248 from mountpoint /dev/vdb
Jul 27 09:44:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Attempting to detach device vdb from instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:44:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:44:41 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:44:41 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:44:41 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:44:41 user nova-compute[70374]:   <serial>d85fc96b-076c-4399-a10f-a6468bb76248</serial>
Jul 27 09:44:41 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 09:44:41 user nova-compute[70374]: </disk>
Jul 27 09:44:41 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:44:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully detached device vdb from instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 from the persistent domain config.
Jul 27 09:44:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:44:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:44:41 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:44:41 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:44:41 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:44:41 user nova-compute[70374]:   <serial>d85fc96b-076c-4399-a10f-a6468bb76248</serial>
Jul 27 09:44:41 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 09:44:41 user nova-compute[70374]: </disk>
Jul 27 09:44:41 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451082.169181, 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:44:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully detached device vdb from instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 from the live domain config.
Jul 27 09:44:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrDofsOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:44:42 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da3342-c224-4d3a-bc7f-66f000aecedb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:44:42 user nova-compute[70374]: No targets found.
Jul 27 09:44:42 user nova-compute[70374]: iSNS:
Jul 27 09:44:42 user nova-compute[70374]: No targets found.
Jul 27 09:44:42 user nova-compute[70374]: STATIC:
Jul 27 09:44:42 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248
Jul 27 09:44:42 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:44:42 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:44:42 user nova-compute[70374]: FIRMWARE:
Jul 27 09:44:42 user nova-compute[70374]: No targets found.
Jul 27 09:44:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:44:42 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:44:42 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aef32c7-43d3-47e2-84f2-56117d7d29d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad79e369-391f-4564-8f2e-56d3d0ff9902]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:44:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 (non-flash)
Jul 27 09:44:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc4e6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c43ce-1398-448b-af79-323e9fe4614e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a25273-ccb9-445d-a3e4-db88cb690b61]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d7ccc4-4814-4c68-995f-1cc4a96ba550]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6d5491-3450-4bac-88dd-08f738b5c5c4]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4d3ab6-5567-4179-a90a-d74b8455f6a2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e19740-7e7a-4748-ad36-37211bd7b610]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260]
Jul 27 09:44:42 user nova-compute[70374]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248, portal: 172.16.0.220,3260] successful.
Jul 27 09:44:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85fc96b-076c-4399-a10f-a6468bb76248 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[382a5584-1332-4b84-a334-a97745b51a54]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== disconnect_volume: return (301ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:44:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:44:43 user nova-compute[70374]: DEBUG nova.objects.instance [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'flavor' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:44:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-03804b34-b848-4d96-bec2-def14380d64a tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.746s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrCanvqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:44:44 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:44:44 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:44:44 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ce1d7-896e-459d-b2cc-1d104db1e9b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:44:44 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e37739-16e9-4c96-a68d-46e830c95a22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7] added
Jul 27 09:44:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[068fbd84-20e9-46b6-a32d-3a0ce975555a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb5d86-72de-4b87-8e98-ee8431a9e7f5]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrCanvqO {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrCanvqO" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9fd060-185c-4440-ab70-e03754dc5c4b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MrCanvqO'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e460435-17f8-4ae9-b5c0-e428592a7217]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720b5ba-1ae9-4a1b-8583-c3b23c544362]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:44:44 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:44:44 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:44:44 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 09:44:44 user nova-compute[70374]: 
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e312fa1-1c79-4e95-91b6-0e12a23bca4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7, portal: 172.16.0.220,3260]
Jul 27 09:44:44 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7, portal: 172.16.0.220,3260] successful.
Jul 27 09:44:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[db980120-b162-4216-ac47-19205b878ada]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3251e315-5d3f-4360-8528-b6794d898f95]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 (non-flash)
Jul 27 09:44:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 (non-flash)
Jul 27 09:44:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef36b83-6ab1-4f7c-80a0-5e710f1460bb]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:44:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrCanvqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:44:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:44:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26661383434366165', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:44:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383434366165', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:44:45 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'flavor' on Instance uuid 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:44:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:44:45 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:44:45 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:44:45 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:44:45 user nova-compute[70374]:   <serial>d09e54a4-23fc-41ed-8697-d06fac206aa7</serial>
Jul 27 09:44:45 user nova-compute[70374]: </disk>
Jul 27 09:44:45 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:44:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:44:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:44:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] No VIF found with MAC fa:16:3e:c5:bb:32, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:44:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1d967124-20c9-4462-ae6d-daee3a5c3d26 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.338s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:44:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:44:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:44:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:44:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:44:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:44:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:44:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:06 user nova-compute[70374]: INFO nova.compute.manager [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Unshelving
Jul 27 09:45:06 user nova-compute[70374]: INFO nova.virt.block_device [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Booting with volume 8400992d-ab79-4e63-9044-f5cf9f27a428 at /dev/vdc
Jul 27 09:45:06 user nova-compute[70374]: DEBUG os_brick.utils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4315f64a-32fe-46e8-bfc2-3889343908f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[842413a7-29f0-4490-8c87-0d64deb7a9bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9d0d2c-e687-4c42-b745-18006dc98222]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55497bfa-b524-472f-ba06-bc782d771daa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:45:07 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:45:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[919d169f-a8e8-4e47-9007-c25fb1ca6876]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG os_brick.utils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:45:07 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating existing volume attachment record: d5e0270f-ae1b-4ff8-9b89-0fc9d68db95a {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:45:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:10 user nova-compute[70374]: INFO nova.compute.manager [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Detaching volume d09e54a4-23fc-41ed-8697-d06fac206aa7
Jul 27 09:45:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:11 user nova-compute[70374]: INFO nova.virt.block_device [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Attempting to driver detach volume d09e54a4-23fc-41ed-8697-d06fac206aa7 from mountpoint /dev/vdb
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Attempting to detach device vdb from instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:45:11 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:45:11 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:45:11 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:45:11 user nova-compute[70374]:   <serial>d09e54a4-23fc-41ed-8697-d06fac206aa7</serial>
Jul 27 09:45:11 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:45:11 user nova-compute[70374]: </disk>
Jul 27 09:45:11 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:45:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Successfully detached device vdb from instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 from the persistent domain config.
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:45:11 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:45:11 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:45:11 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:45:11 user nova-compute[70374]:   <serial>d09e54a4-23fc-41ed-8697-d06fac206aa7</serial>
Jul 27 09:45:11 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:45:11 user nova-compute[70374]: </disk>
Jul 27 09:45:11 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451111.5754626, 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:45:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Successfully detached device vdb from instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 from the live domain config.
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrCanvqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:45:11 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c0fb46-7483-4993-b34c-3b43c16abebf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:45:11 user nova-compute[70374]: No targets found.
Jul 27 09:45:11 user nova-compute[70374]: iSNS:
Jul 27 09:45:11 user nova-compute[70374]: No targets found.
Jul 27 09:45:11 user nova-compute[70374]: STATIC:
Jul 27 09:45:11 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7
Jul 27 09:45:11 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:45:11 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:45:11 user nova-compute[70374]: FIRMWARE:
Jul 27 09:45:11 user nova-compute[70374]: No targets found.
Jul 27 09:45:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:45:11 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:45:11 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[592184c4-9ea1-4d7a-8cac-46f15ee87541]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1aae1d-dea7-4d77-a574-0492baff2147]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 (non-flash)
Jul 27 09:45:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 (non-flash)
Jul 27 09:45:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2800567760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f947fdd8-65e9-48ab-b510-ba21b9ca0df6]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd07f06d-1f9b-4570-83af-f58c9209261e]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[618bd833-84ef-4d92-a970-67e3d1e13f4d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cf9ea4-393c-4119-97c1-26e03c6d61d9]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2845ecca-2f8d-4a6d-a0d8-e8cf65ac0d4a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a88cd8-c005-4aad-9693-face2676a2ee]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7, portal: 172.16.0.220,3260]
Jul 27 09:45:11 user nova-compute[70374]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7, portal: 172.16.0.220,3260] successful.
Jul 27 09:45:11 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cef6eb-8a11-4090-a04b-baadd18cc272]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] <== disconnect_volume: return (299ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:45:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'flavor' on Instance uuid 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f6f1d63-2f4f-4ef4-bc81-e0160d2b5ea2 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.895s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.764s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:12 user nova-compute[70374]: INFO nova.compute.manager [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Terminating instance
Jul 27 09:45:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-4d7d278d-ab61-4396-a7eb-291ede26874a req-ff5c81ae-da5f-477b-89d7-bd3cf0476625 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received event network-vif-unplugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4d7d278d-ab61-4396-a7eb-291ede26874a req-ff5c81ae-da5f-477b-89d7-bd3cf0476625 service nova] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4d7d278d-ab61-4396-a7eb-291ede26874a req-ff5c81ae-da5f-477b-89d7-bd3cf0476625 service nova] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4d7d278d-ab61-4396-a7eb-291ede26874a req-ff5c81ae-da5f-477b-89d7-bd3cf0476625 service nova] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-4d7d278d-ab61-4396-a7eb-291ede26874a req-ff5c81ae-da5f-477b-89d7-bd3cf0476625 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] No waiting events found dispatching network-vif-unplugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-4d7d278d-ab61-4396-a7eb-291ede26874a req-ff5c81ae-da5f-477b-89d7-bd3cf0476625 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received event network-vif-unplugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:45:13 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Instance destroyed successfully.
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.objects.instance [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lazy-loading 'resources' on Instance uuid 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-964408504',display_name='tempest-VolumesSnapshotTestJSON-instance-964408504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-964408504',id=32,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh1jcYHkrJFF9aYp70HLhkQN+PpTv2JGCPlZhHUMv5uC4j1qzjlbcl9o/cOvCnHucFRvDybjYsO19309Ok47edVpSIVz1t5faEOyPevp9qqI3C4tX6aMCeEo335YZdH9Q==',key_name='tempest-keypair-571414827',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d47c627f4a94472a80b922a262aa172',ramdisk_id='',reservation_id='r-h5z4odtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1299698694',owner_user_name='tempest-VolumesSnapshotTestJSON-1299698694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce8d942c3b93453bafa8381f39ec85a9',uuid=1695cfe5-48ad-4d44-8eeb-7a3064f05ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converting VIF {"id": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "address": "fa:16:3e:c5:bb:32", "network": {"id": "c6f59f88-a6e1-40eb-91bd-6c46a446e1bc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-757182711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d47c627f4a94472a80b922a262aa172", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10f91912-fc", "ovs_interfaceid": "10f91912-fc13-4fb8-a5eb-a47f17b5e749", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=10f91912-fc13-4fb8-a5eb-a47f17b5e749,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f91912-fc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG os_vif [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=10f91912-fc13-4fb8-a5eb-a47f17b5e749,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f91912-fc') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10f91912-fc, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:13 user nova-compute[70374]: INFO os_vif [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=10f91912-fc13-4fb8-a5eb-a47f17b5e749,network=Network(c6f59f88-a6e1-40eb-91bd-6c46a446e1bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10f91912-fc')
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:d09e54a4-23fc-41ed-8697-d06fac206aa7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrCanvqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:45:13 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:45:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7d5cafdf-f98e-49b5-a38c-976234c6395c]: Unexpected error while running command.
Jul 27 09:45:13 user nova-compute[70374]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 09:45:13 user nova-compute[70374]: Exit code: 21
Jul 27 09:45:13 user nova-compute[70374]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 09:45:13 user nova-compute[70374]: Stderr: '' {{(pid=82164) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Jul 27 09:45:13 user nova-compute[70374]: Traceback (most recent call last):
Jul 27 09:45:13 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jul 27 09:45:13 user nova-compute[70374]:     ret = func(*f_args, **f_kwargs)
Jul 27 09:45:13 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jul 27 09:45:13 user nova-compute[70374]:     return func(*args, **kwargs)
Jul 27 09:45:13 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jul 27 09:45:13 user nova-compute[70374]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jul 27 09:45:13 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jul 27 09:45:13 user nova-compute[70374]:     return putils.execute(on_execute=on_execute,
Jul 27 09:45:13 user nova-compute[70374]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Jul 27 09:45:13 user nova-compute[70374]:     raise ProcessExecutionError(exit_code=_returncode,
Jul 27 09:45:13 user nova-compute[70374]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 09:45:13 user nova-compute[70374]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 09:45:13 user nova-compute[70374]: Exit code: 21
Jul 27 09:45:13 user nova-compute[70374]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 09:45:13 user nova-compute[70374]: Stderr: ''
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5cafdf-f98e-49b5-a38c-976234c6395c]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 09:45:13 user nova-compute[70374]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 09:45:13 user nova-compute[70374]: Exit code: 21
Jul 27 09:45:13 user nova-compute[70374]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 09:45:13 user nova-compute[70374]: Stderr: ''
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Jul 27 09:45:13 user nova-compute[70374]: ERROR os_brick.initiator.connectors.iscsi 
Jul 27 09:45:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=70374) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.026s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] <== disconnect_volume: return (27ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:45:13 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Deleting instance files /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8_del
Jul 27 09:45:13 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Deletion of /opt/stack/data/nova/instances/1695cfe5-48ad-4d44-8eeb-7a3064f05ae8_del complete
Jul 27 09:45:13 user nova-compute[70374]: INFO nova.compute.manager [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 27 09:45:13 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:45:13 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:45:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:14 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:45:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:45:14 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:45:14 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:15 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Took 1.39 seconds to deallocate network for instance.
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-29fe7e23-cbc8-4012-9671-20f64be39a57 req-584df6dc-aa89-47f4-bf07-deec6e98c586 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received event network-vif-deleted-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:15 user nova-compute[70374]: INFO nova.compute.manager [req-29fe7e23-cbc8-4012-9671-20f64be39a57 req-584df6dc-aa89-47f4-bf07-deec6e98c586 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Neutron deleted interface 10f91912-fc13-4fb8-a5eb-a47f17b5e749; detaching it from the instance and deleting it from the info cache
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.network.neutron [req-29fe7e23-cbc8-4012-9671-20f64be39a57 req-584df6dc-aa89-47f4-bf07-deec6e98c586 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-6ebfff5b-4cec-4da6-914a-2b68c5703040 req-e572bbac-76c3-4602-8230-f5aaad1f9bc7 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received event network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6ebfff5b-4cec-4da6-914a-2b68c5703040 req-e572bbac-76c3-4602-8230-f5aaad1f9bc7 service nova] Acquiring lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6ebfff5b-4cec-4da6-914a-2b68c5703040 req-e572bbac-76c3-4602-8230-f5aaad1f9bc7 service nova] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6ebfff5b-4cec-4da6-914a-2b68c5703040 req-e572bbac-76c3-4602-8230-f5aaad1f9bc7 service nova] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-6ebfff5b-4cec-4da6-914a-2b68c5703040 req-e572bbac-76c3-4602-8230-f5aaad1f9bc7 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] No waiting events found dispatching network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:45:15 user nova-compute[70374]: WARNING nova.compute.manager [req-6ebfff5b-4cec-4da6-914a-2b68c5703040 req-e572bbac-76c3-4602-8230-f5aaad1f9bc7 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Received unexpected event network-vif-plugged-10f91912-fc13-4fb8-a5eb-a47f17b5e749 for instance with vm_state active and task_state deleting.
Jul 27 09:45:15 user nova-compute[70374]: WARNING nova.volume.cinder [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Attachment 8ec22cbd-10d1-4103-a770-bca1ec936d0b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8ec22cbd-10d1-4103-a770-bca1ec936d0b. (HTTP 404) (Request-ID: req-c8901136-de43-4ba1-9b42-c46914fcbf96)
Jul 27 09:45:15 user nova-compute[70374]: INFO nova.compute.manager [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Took 0.03 seconds to detach 1 volumes for instance.
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-29fe7e23-cbc8-4012-9671-20f64be39a57 req-584df6dc-aa89-47f4-bf07-deec6e98c586 service nova] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Detach interface failed, port_id=10f91912-fc13-4fb8-a5eb-a47f17b5e749, reason: Instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updating instance_info_cache with network_info: [{"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-6ae93f34-ce7e-4ae4-a5ba-36508361bd54" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:45:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:15 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Deleted allocations for instance 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8
Jul 27 09:45:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-348ab93f-58cb-4c54-9254-38e3e03a6488 tempest-VolumesSnapshotTestJSON-1299698694 tempest-VolumesSnapshotTestJSON-1299698694-project-member] Lock "1695cfe5-48ad-4d44-8eeb-7a3064f05ae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.846s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'pci_requests' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'numa_topology' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:18 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:45:18 user nova-compute[70374]: INFO nova.compute.claims [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Claim successful on node user
Jul 27 09:45:18 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:45:18 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:45:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:19 user nova-compute[70374]: INFO nova.network.neutron [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating port dfa2198f-6276-43cd-8b58-8281d4424143 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquired lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-4ffec9da-0b1c-4e91-b33e-12a48096ce86 req-dc79c13d-71d8-4959-9c54-9a44c388d715 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-changed-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-4ffec9da-0b1c-4e91-b33e-12a48096ce86 req-dc79c13d-71d8-4959-9c54-9a44c388d715 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Refreshing instance network info cache due to event network-changed-dfa2198f-6276-43cd-8b58-8281d4424143. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4ffec9da-0b1c-4e91-b33e-12a48096ce86 req-dc79c13d-71d8-4959-9c54-9a44c388d715 service nova] Acquiring lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG nova.network.neutron [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating instance_info_cache with network_info: [{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Releasing lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:45:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Creating image(s)
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'trusted_certs' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4ffec9da-0b1c-4e91-b33e-12a48096ce86 req-dc79c13d-71d8-4959-9c54-9a44c388d715 service nova] Acquired lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG nova.network.neutron [req-4ffec9da-0b1c-4e91-b33e-12a48096ce86 req-dc79c13d-71d8-4959-9c54-9a44c388d715 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Refreshing network info cache for port dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "bae11d73797624eb189e8f6bc965bcd6277bd72e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "bae11d73797624eb189e8f6bc965bcd6277bd72e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190/disk --force-share --output=json" returned: 0 in 0.500s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e.part --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG nova.virt.images [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] 9d98afe4-f2cd-4311-ac89-8176d5f691d7 was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e.part /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG nova.network.neutron [req-4ffec9da-0b1c-4e91-b33e-12a48096ce86 req-dc79c13d-71d8-4959-9c54-9a44c388d715 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updated VIF entry in instance network info cache for port dfa2198f-6276-43cd-8b58-8281d4424143. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG nova.network.neutron [req-4ffec9da-0b1c-4e91-b33e-12a48096ce86 req-dc79c13d-71d8-4959-9c54-9a44c388d715 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating instance_info_cache with network_info: [{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4ffec9da-0b1c-4e91-b33e-12a48096ce86 req-dc79c13d-71d8-4959-9c54-9a44c388d715 service nova] Releasing lock "refresh_cache-56ab07d0-823d-4282-bdc5-21910c33678a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e.part /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e.converted" returned: 0 in 0.576s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e.converted --force-share --output=json" returned: 0 in 0.442s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "bae11d73797624eb189e8f6bc965bcd6277bd72e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.366s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:23 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:45:23 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8204MB free_disk=25.468769073486328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e --force-share --output=json" returned: 0 in 0.162s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "bae11d73797624eb189e8f6bc965bcd6277bd72e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "bae11d73797624eb189e8f6bc965bcd6277bd72e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 66911d11-4025-4243-9f8e-ff0909460190 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (f7548644-4a09-4ad8-9aa6-6e05d85a9f5b): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1751}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e,backing_fmt=raw /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e,backing_fmt=raw /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk 1073741824" returned: 0 in 0.054s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "bae11d73797624eb189e8f6bc965bcd6277bd72e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'migration_context' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Rebasing disk image.
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 -F raw /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:24 user nova-compute[70374]: INFO nova.compute.manager [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Terminating instance
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-72dd4865-caa7-41ad-97bb-2b1232958c02 req-e3859978-69a3-4586-a8a9-03e31c88d191 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-72dd4865-caa7-41ad-97bb-2b1232958c02 req-e3859978-69a3-4586-a8a9-03e31c88d191 service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-72dd4865-caa7-41ad-97bb-2b1232958c02 req-e3859978-69a3-4586-a8a9-03e31c88d191 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-72dd4865-caa7-41ad-97bb-2b1232958c02 req-e3859978-69a3-4586-a8a9-03e31c88d191 service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-72dd4865-caa7-41ad-97bb-2b1232958c02 req-e3859978-69a3-4586-a8a9-03e31c88d191 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-72dd4865-caa7-41ad-97bb-2b1232958c02 req-e3859978-69a3-4586-a8a9-03e31c88d191 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-unplugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:45:24 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Instance destroyed successfully.
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.objects.instance [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'resources' on Instance uuid 66911d11-4025-4243-9f8e-ff0909460190 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1128759625',display_name='tempest-ServerRescueNegativeTestJSON-server-1128759625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1128759625',id=26,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZj+k3Bgy7oCtHJzEs2H3+NxtBrthZmd6r3Jc2RDUxkkti9jy66392CRnCtb3zi3qP5p5VGM/NEkUBAuG/ZEYZAP/D4yV5s2fCbg7QBbglGQvwL3bBpZRdJLzIVLbkOqA==',key_name='tempest-keypair-601043870',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:40:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-a1q2nab0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=66911d11-4025-4243-9f8e-ff0909460190,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "c5e7d75d-7b90-4a67-a548-f829c290e294", "address": "fa:16:3e:02:4c:b3", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e7d75d-7b", "ovs_interfaceid": "c5e7d75d-7b90-4a67-a548-f829c290e294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c5e7d75d-7b90-4a67-a548-f829c290e294,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e7d75d-7b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG os_vif [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c5e7d75d-7b90-4a67-a548-f829c290e294,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e7d75d-7b') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e7d75d-7b, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:45:24 user nova-compute[70374]: INFO os_vif [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c5e7d75d-7b90-4a67-a548-f829c290e294,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e7d75d-7b')
Jul 27 09:45:24 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Deleting instance files /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190_del
Jul 27 09:45:24 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Deletion of /opt/stack/data/nova/instances/66911d11-4025-4243-9f8e-ff0909460190_del complete
Jul 27 09:45:24 user nova-compute[70374]: INFO nova.compute.manager [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 09:45:24 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:45:24 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 -F raw /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk" returned: 0 in 2.604s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Ensure instance console log exists: /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Start _get_guest_xml network_info=[{"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='0ba8a507beb4123a879104f824b66672',container_format='bare',created_at=2023-07-27T09:43:13Z,direct_url=<?>,disk_format='qcow2',id=9d98afe4-f2cd-4311-ac89-8176d5f691d7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1038229673-shelved',owner='5d32e43d96bc4f0a99fd3378c1677fb7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T09:43:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'd5e0270f-ae1b-4ff8-9b89-0fc9d68db95a', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCYWFJpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '56ab07d0-823d-4282-bdc5-21910c33678a', 'attached_at': '', 'detached_at': '', 'volume_id': '8400992d-ab79-4e63-9044-f5cf9f27a428', 'serial': '8400992d-ab79-4e63-9044-f5cf9f27a428'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:45:26 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:45:26 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0ba8a507beb4123a879104f824b66672',container_format='bare',created_at=2023-07-27T09:43:13Z,direct_url=<?>,disk_format='qcow2',id=9d98afe4-f2cd-4311-ac89-8176d5f691d7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1038229673-shelved',owner='5d32e43d96bc4f0a99fd3378c1677fb7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T09:43:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCYWFJpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:45:26 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:45:26 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:45:26 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-053f9943-47e2-419e-842e-d61ca3f21105 req-0529b007-02be-450d-9826-68aa2e1a7ee1 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-deleted-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:26 user nova-compute[70374]: INFO nova.compute.manager [req-053f9943-47e2-419e-842e-d61ca3f21105 req-0529b007-02be-450d-9826-68aa2e1a7ee1 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Neutron deleted interface c5e7d75d-7b90-4a67-a548-f829c290e294; detaching it from the instance and deleting it from the info cache
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-053f9943-47e2-419e-842e-d61ca3f21105 req-0529b007-02be-450d-9826-68aa2e1a7ee1 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dde42c-7bd7-4d9b-a58d-88b804ac9bfb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:45:26 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-053f9943-47e2-419e-842e-d61ca3f21105 req-0529b007-02be-450d-9826-68aa2e1a7ee1 service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Detach interface failed, port_id=c5e7d75d-7b90-4a67-a548-f829c290e294, reason: Instance 66911d11-4025-4243-9f8e-ff0909460190 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:45:26 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Took 1.50 seconds to deallocate network for instance.
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-49cfaafd-c48a-4a6f-987f-2f05d20d42f6 req-cdc6f346-76ac-4407-9b10-a78a1960affe service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-49cfaafd-c48a-4a6f-987f-2f05d20d42f6 req-cdc6f346-76ac-4407-9b10-a78a1960affe service nova] Acquiring lock "66911d11-4025-4243-9f8e-ff0909460190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-49cfaafd-c48a-4a6f-987f-2f05d20d42f6 req-cdc6f346-76ac-4407-9b10-a78a1960affe service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-49cfaafd-c48a-4a6f-987f-2f05d20d42f6 req-cdc6f346-76ac-4407-9b10-a78a1960affe service nova] Lock "66911d11-4025-4243-9f8e-ff0909460190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-49cfaafd-c48a-4a6f-987f-2f05d20d42f6 req-cdc6f346-76ac-4407-9b10-a78a1960affe service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] No waiting events found dispatching network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:45:26 user nova-compute[70374]: WARNING nova.compute.manager [req-49cfaafd-c48a-4a6f-987f-2f05d20d42f6 req-cdc6f346-76ac-4407-9b10-a78a1960affe service nova] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Received unexpected event network-vif-plugged-c5e7d75d-7b90-4a67-a548-f829c290e294 for instance with vm_state active and task_state deleting.
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5b863-5ef7-4b93-9fc7-4255c99a268d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428] added
Jul 27 09:45:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a25b09-b7c1-4529-b387-0fb9a8faf272]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b841958-c2b3-400c-81d1-bca8b1cc830a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCYWFJpg {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCYWFJpg" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6f4163-fd18-4462-9cc3-b7870b3b72cf]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LCYWFJpg'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[149db7af-0583-46b6-9f52-90259e45b738]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98d4699-4704-4566-b1aa-59694575935c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:45:26 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:45:26 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:45:26 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 09:45:26 user nova-compute[70374]: 
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[942dd1b0-fe4f-49ac-8f34-0194f9ad5510]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428, portal: 172.16.0.220,3260]
Jul 27 09:45:26 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428, portal: 172.16.0.220,3260] successful.
Jul 27 09:45:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b5818-6e21-4a07-9e83-cd9745302cc7]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[95504bff-1e07-4422-8152-d0f607215331]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:45:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:45:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0f6a91-fec4-4901-98f1-fee90447d016]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCYWFJpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:26 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Deleted allocations for instance 66911d11-4025-4243-9f8e-ff0909460190
Jul 27 09:45:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-46c601af-12ee-47f7-82c0-3d444ed94427 tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "66911d11-4025-4243-9f8e-ff0909460190" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23266613332333835', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266613332333835', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038229673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1038229673',id=30,image_ref='9d98afe4-f2cd-4311-ac89-8176d5f691d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1092477681',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-1ws0fl1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member',shelved_at='2023-07-27T09:43:18.000030',shelved_host='user',shelved_image_id='9d98afe4-f2cd-4311-ac89-8176d5f691d7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=56ab07d0-823d-4282-bdc5-21910c33678a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'pci_devices' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:45:27 user nova-compute[70374]:   <uuid>56ab07d0-823d-4282-bdc5-21910c33678a</uuid>
Jul 27 09:45:27 user nova-compute[70374]:   <name>instance-0000001e</name>
Jul 27 09:45:27 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:45:27 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:45:27 user nova-compute[70374]:   <metadata>
Jul 27 09:45:27 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:45:27 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:45:27 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1038229673</nova:name>
Jul 27 09:45:27 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:45:26</nova:creationTime>
Jul 27 09:45:27 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:45:27 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:45:27 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:45:27 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:45:27 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:45:27 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:45:27 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:45:27 user nova-compute[70374]:       <nova:owner>
Jul 27 09:45:27 user nova-compute[70374]:         <nova:user uuid="377915ad2c6e4244b5bd1a7ed97c6afb">tempest-AttachVolumeShelveTestJSON-1605888290-project-member</nova:user>
Jul 27 09:45:27 user nova-compute[70374]:         <nova:project uuid="5d32e43d96bc4f0a99fd3378c1677fb7">tempest-AttachVolumeShelveTestJSON-1605888290</nova:project>
Jul 27 09:45:27 user nova-compute[70374]:       </nova:owner>
Jul 27 09:45:27 user nova-compute[70374]:       <nova:root type="image" uuid="9d98afe4-f2cd-4311-ac89-8176d5f691d7"/>
Jul 27 09:45:27 user nova-compute[70374]:       <nova:ports>
Jul 27 09:45:27 user nova-compute[70374]:         <nova:port uuid="dfa2198f-6276-43cd-8b58-8281d4424143">
Jul 27 09:45:27 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 09:45:27 user nova-compute[70374]:         </nova:port>
Jul 27 09:45:27 user nova-compute[70374]:       </nova:ports>
Jul 27 09:45:27 user nova-compute[70374]:     </nova:instance>
Jul 27 09:45:27 user nova-compute[70374]:   </metadata>
Jul 27 09:45:27 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:45:27 user nova-compute[70374]:     <system>
Jul 27 09:45:27 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:45:27 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:45:27 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:45:27 user nova-compute[70374]:       <entry name="serial">56ab07d0-823d-4282-bdc5-21910c33678a</entry>
Jul 27 09:45:27 user nova-compute[70374]:       <entry name="uuid">56ab07d0-823d-4282-bdc5-21910c33678a</entry>
Jul 27 09:45:27 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:45:27 user nova-compute[70374]:     </system>
Jul 27 09:45:27 user nova-compute[70374]:   </sysinfo>
Jul 27 09:45:27 user nova-compute[70374]:   <os>
Jul 27 09:45:27 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:45:27 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:45:27 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:45:27 user nova-compute[70374]:   </os>
Jul 27 09:45:27 user nova-compute[70374]:   <features>
Jul 27 09:45:27 user nova-compute[70374]:     <acpi/>
Jul 27 09:45:27 user nova-compute[70374]:     <apic/>
Jul 27 09:45:27 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:45:27 user nova-compute[70374]:   </features>
Jul 27 09:45:27 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:45:27 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:45:27 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:45:27 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:45:27 user nova-compute[70374]:   </clock>
Jul 27 09:45:27 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:45:27 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:45:27 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:45:27 user nova-compute[70374]:   </cpu>
Jul 27 09:45:27 user nova-compute[70374]:   <devices>
Jul 27 09:45:27 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:45:27 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:45:27 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk"/>
Jul 27 09:45:27 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:45:27 user nova-compute[70374]:     </disk>
Jul 27 09:45:27 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:45:27 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:45:27 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 09:45:27 user nova-compute[70374]:       <target dev="vdc" bus="virtio"/>
Jul 27 09:45:27 user nova-compute[70374]:       <serial>8400992d-ab79-4e63-9044-f5cf9f27a428</serial>
Jul 27 09:45:27 user nova-compute[70374]:     </disk>
Jul 27 09:45:27 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:45:27 user nova-compute[70374]:       <mac address="fa:16:3e:e9:1f:ee"/>
Jul 27 09:45:27 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:45:27 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:45:27 user nova-compute[70374]:       <target dev="tapdfa2198f-62"/>
Jul 27 09:45:27 user nova-compute[70374]:     </interface>
Jul 27 09:45:27 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:45:27 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/console.log" append="off"/>
Jul 27 09:45:27 user nova-compute[70374]:     </serial>
Jul 27 09:45:27 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:45:27 user nova-compute[70374]:     <video>
Jul 27 09:45:27 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:45:27 user nova-compute[70374]:     </video>
Jul 27 09:45:27 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:45:27 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:45:27 user nova-compute[70374]:     </rng>
Jul 27 09:45:27 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:45:27 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:45:27 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:45:27 user nova-compute[70374]:     </memballoon>
Jul 27 09:45:27 user nova-compute[70374]:   </devices>
Jul 27 09:45:27 user nova-compute[70374]: </domain>
Jul 27 09:45:27 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038229673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1038229673',id=30,image_ref='9d98afe4-f2cd-4311-ac89-8176d5f691d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1092477681',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-1ws0fl1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member',shelved_at='2023-07-27T09:43:18.000030',shelved_host='user',shelved_image_id='9d98afe4-f2cd-4311-ac89-8176d5f691d7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=56ab07d0-823d-4282-bdc5-21910c33678a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG os_vif [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfa2198f-62, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfa2198f-62, col_values=(('external_ids', {'iface-id': 'dfa2198f-6276-43cd-8b58-8281d4424143', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:1f:ee', 'vm-uuid': '56ab07d0-823d-4282-bdc5-21910c33678a'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:27 user nova-compute[70374]: INFO os_vif [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62')
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:45:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No VIF found with MAC fa:16:3e:e9:1f:ee, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:45:28 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451113.506554, 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:45:28 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] VM Stopped (Lifecycle Event)
Jul 27 09:45:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-12bc387e-2a07-49e1-85ff-0e26d8520fb3 None None] [instance: 1695cfe5-48ad-4d44-8eeb-7a3064f05ae8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:45:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-9eea0c18-8814-40f6-854e-d88e121ccd52 req-5bc94f1e-dc32-47f3-9699-a594d8d5e347 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9eea0c18-8814-40f6-854e-d88e121ccd52 req-5bc94f1e-dc32-47f3-9699-a594d8d5e347 service nova] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9eea0c18-8814-40f6-854e-d88e121ccd52 req-5bc94f1e-dc32-47f3-9699-a594d8d5e347 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9eea0c18-8814-40f6-854e-d88e121ccd52 req-5bc94f1e-dc32-47f3-9699-a594d8d5e347 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-9eea0c18-8814-40f6-854e-d88e121ccd52 req-5bc94f1e-dc32-47f3-9699-a594d8d5e347 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] No waiting events found dispatching network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:45:29 user nova-compute[70374]: WARNING nova.compute.manager [req-9eea0c18-8814-40f6-854e-d88e121ccd52 req-5bc94f1e-dc32-47f3-9699-a594d8d5e347 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received unexpected event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 09:45:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451131.6624024, 56ab07d0-823d-4282-bdc5-21910c33678a => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:45:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] VM Resumed (Lifecycle Event)
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:45:31 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance spawned successfully.
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-e8c98bcc-1dff-4f51-80ee-31a1f39df6fc req-a209266f-1fc1-4cb0-9bd2-9a75f9684840 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8c98bcc-1dff-4f51-80ee-31a1f39df6fc req-a209266f-1fc1-4cb0-9bd2-9a75f9684840 service nova] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8c98bcc-1dff-4f51-80ee-31a1f39df6fc req-a209266f-1fc1-4cb0-9bd2-9a75f9684840 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e8c98bcc-1dff-4f51-80ee-31a1f39df6fc req-a209266f-1fc1-4cb0-9bd2-9a75f9684840 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-e8c98bcc-1dff-4f51-80ee-31a1f39df6fc req-a209266f-1fc1-4cb0-9bd2-9a75f9684840 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] No waiting events found dispatching network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:45:31 user nova-compute[70374]: WARNING nova.compute.manager [req-e8c98bcc-1dff-4f51-80ee-31a1f39df6fc req-a209266f-1fc1-4cb0-9bd2-9a75f9684840 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received unexpected event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 09:45:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451131.665307, 56ab07d0-823d-4282-bdc5-21910c33678a => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:45:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] VM Started (Lifecycle Event)
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:45:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:45:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:45:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:45:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e087e4b9-d20e-4daf-827c-af3f5e4c867c tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.397s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "fe923721-b4e2-4735-823f-dae34d703018" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "fe923721-b4e2-4735-823f-dae34d703018" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:45:37 user nova-compute[70374]: INFO nova.compute.claims [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Claim successful on node user
Jul 27 09:45:37 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:45:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:45:37 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:45:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:45:38 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Creating image(s)
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "/opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "/opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG nova.policy [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a1c91b06b624fa399c78ff15179865d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc977727b20a4c11b1ec74819dc479d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.159s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk 1073741824" returned: 0 in 0.061s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.177s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:45:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Cannot resize image /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lazy-loading 'migration_context' on Instance uuid fe923721-b4e2-4735-823f-dae34d703018 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Ensure instance console log exists: /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Successfully created port: 0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:45:39 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451124.8429947, 66911d11-4025-4243-9f8e-ff0909460190 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:45:39 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 66911d11-4025-4243-9f8e-ff0909460190] VM Stopped (Lifecycle Event)
Jul 27 09:45:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4411d42b-a200-43e6-b6c6-7d37d1b5e637 None None] [instance: 66911d11-4025-4243-9f8e-ff0909460190] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Successfully updated port: 0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "refresh_cache-fe923721-b4e2-4735-823f-dae34d703018" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquired lock "refresh_cache-fe923721-b4e2-4735-823f-dae34d703018" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-7fa625b2-7d03-41dc-9a63-865c6b058e89 req-34c5a31d-ee5d-4be8-84a5-0c91e94095b4 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received event network-changed-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-7fa625b2-7d03-41dc-9a63-865c6b058e89 req-34c5a31d-ee5d-4be8-84a5-0c91e94095b4 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Refreshing instance network info cache due to event network-changed-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7fa625b2-7d03-41dc-9a63-865c6b058e89 req-34c5a31d-ee5d-4be8-84a5-0c91e94095b4 service nova] Acquiring lock "refresh_cache-fe923721-b4e2-4735-823f-dae34d703018" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.neutron [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Updating instance_info_cache with network_info: [{"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Releasing lock "refresh_cache-fe923721-b4e2-4735-823f-dae34d703018" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Instance network_info: |[{"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7fa625b2-7d03-41dc-9a63-865c6b058e89 req-34c5a31d-ee5d-4be8-84a5-0c91e94095b4 service nova] Acquired lock "refresh_cache-fe923721-b4e2-4735-823f-dae34d703018" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-7fa625b2-7d03-41dc-9a63-865c6b058e89 req-34c5a31d-ee5d-4be8-84a5-0c91e94095b4 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Refreshing network info cache for port 0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Start _get_guest_xml network_info=[{"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:45:40 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:45:40 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-653845909',display_name='tempest-VolumesNegativeTest-instance-653845909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-653845909',id=33,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc977727b20a4c11b1ec74819dc479d2',ramdisk_id='',reservation_id='r-4ypdx7mh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1633535875',owner_user_name='tempest-VolumesNegativeTest-1633535875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:45:38Z,user_data=None,user_id='8a1c91b06b624fa399c78ff15179865d',uuid=fe923721-b4e2-4735-823f-dae34d703018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Converting VIF {"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=0a8fa314-033f-4fd4-b6b9-eae84b9e59e1,network=Network(267c45e5-9823-49cc-bb4e-150e04e511d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8fa314-03') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lazy-loading 'pci_devices' on Instance uuid fe923721-b4e2-4735-823f-dae34d703018 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:45:40 user nova-compute[70374]:   <uuid>fe923721-b4e2-4735-823f-dae34d703018</uuid>
Jul 27 09:45:40 user nova-compute[70374]:   <name>instance-00000021</name>
Jul 27 09:45:40 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:45:40 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:45:40 user nova-compute[70374]:   <metadata>
Jul 27 09:45:40 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:45:40 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:45:40 user nova-compute[70374]:       <nova:name>tempest-VolumesNegativeTest-instance-653845909</nova:name>
Jul 27 09:45:40 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:45:40</nova:creationTime>
Jul 27 09:45:40 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:45:40 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:45:40 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:45:40 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:45:40 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:45:40 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:45:40 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:45:40 user nova-compute[70374]:       <nova:owner>
Jul 27 09:45:40 user nova-compute[70374]:         <nova:user uuid="8a1c91b06b624fa399c78ff15179865d">tempest-VolumesNegativeTest-1633535875-project-member</nova:user>
Jul 27 09:45:40 user nova-compute[70374]:         <nova:project uuid="dc977727b20a4c11b1ec74819dc479d2">tempest-VolumesNegativeTest-1633535875</nova:project>
Jul 27 09:45:40 user nova-compute[70374]:       </nova:owner>
Jul 27 09:45:40 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:45:40 user nova-compute[70374]:       <nova:ports>
Jul 27 09:45:40 user nova-compute[70374]:         <nova:port uuid="0a8fa314-033f-4fd4-b6b9-eae84b9e59e1">
Jul 27 09:45:40 user nova-compute[70374]:           <nova:ip type="fixed" address="192.168.233.48" ipVersion="4"/>
Jul 27 09:45:40 user nova-compute[70374]:         </nova:port>
Jul 27 09:45:40 user nova-compute[70374]:       </nova:ports>
Jul 27 09:45:40 user nova-compute[70374]:     </nova:instance>
Jul 27 09:45:40 user nova-compute[70374]:   </metadata>
Jul 27 09:45:40 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:45:40 user nova-compute[70374]:     <system>
Jul 27 09:45:40 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:45:40 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:45:40 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:45:40 user nova-compute[70374]:       <entry name="serial">fe923721-b4e2-4735-823f-dae34d703018</entry>
Jul 27 09:45:40 user nova-compute[70374]:       <entry name="uuid">fe923721-b4e2-4735-823f-dae34d703018</entry>
Jul 27 09:45:40 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:45:40 user nova-compute[70374]:     </system>
Jul 27 09:45:40 user nova-compute[70374]:   </sysinfo>
Jul 27 09:45:40 user nova-compute[70374]:   <os>
Jul 27 09:45:40 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:45:40 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:45:40 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:45:40 user nova-compute[70374]:   </os>
Jul 27 09:45:40 user nova-compute[70374]:   <features>
Jul 27 09:45:40 user nova-compute[70374]:     <acpi/>
Jul 27 09:45:40 user nova-compute[70374]:     <apic/>
Jul 27 09:45:40 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:45:40 user nova-compute[70374]:   </features>
Jul 27 09:45:40 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:45:40 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:45:40 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:45:40 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:45:40 user nova-compute[70374]:   </clock>
Jul 27 09:45:40 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:45:40 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:45:40 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:45:40 user nova-compute[70374]:   </cpu>
Jul 27 09:45:40 user nova-compute[70374]:   <devices>
Jul 27 09:45:40 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:45:40 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:45:40 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk"/>
Jul 27 09:45:40 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:45:40 user nova-compute[70374]:     </disk>
Jul 27 09:45:40 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:45:40 user nova-compute[70374]:       <mac address="fa:16:3e:f0:68:ae"/>
Jul 27 09:45:40 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:45:40 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:45:40 user nova-compute[70374]:       <target dev="tap0a8fa314-03"/>
Jul 27 09:45:40 user nova-compute[70374]:     </interface>
Jul 27 09:45:40 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:45:40 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/console.log" append="off"/>
Jul 27 09:45:40 user nova-compute[70374]:     </serial>
Jul 27 09:45:40 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:45:40 user nova-compute[70374]:     <video>
Jul 27 09:45:40 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:45:40 user nova-compute[70374]:     </video>
Jul 27 09:45:40 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:45:40 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:45:40 user nova-compute[70374]:     </rng>
Jul 27 09:45:40 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:45:40 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:45:40 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:45:40 user nova-compute[70374]:     </memballoon>
Jul 27 09:45:40 user nova-compute[70374]:   </devices>
Jul 27 09:45:40 user nova-compute[70374]: </domain>
Jul 27 09:45:40 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-653845909',display_name='tempest-VolumesNegativeTest-instance-653845909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-653845909',id=33,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc977727b20a4c11b1ec74819dc479d2',ramdisk_id='',reservation_id='r-4ypdx7mh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1633535875',owner_user_name='tempest-VolumesNegativeTest-1633535875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:45:38Z,user_data=None,user_id='8a1c91b06b624fa399c78ff15179865d',uuid=fe923721-b4e2-4735-823f-dae34d703018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Converting VIF {"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=0a8fa314-033f-4fd4-b6b9-eae84b9e59e1,network=Network(267c45e5-9823-49cc-bb4e-150e04e511d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8fa314-03') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG os_vif [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=0a8fa314-033f-4fd4-b6b9-eae84b9e59e1,network=Network(267c45e5-9823-49cc-bb4e-150e04e511d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8fa314-03') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a8fa314-03, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a8fa314-03, col_values=(('external_ids', {'iface-id': '0a8fa314-033f-4fd4-b6b9-eae84b9e59e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:68:ae', 'vm-uuid': 'fe923721-b4e2-4735-823f-dae34d703018'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:45:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:40 user nova-compute[70374]: INFO os_vif [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=0a8fa314-033f-4fd4-b6b9-eae84b9e59e1,network=Network(267c45e5-9823-49cc-bb4e-150e04e511d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8fa314-03')
Jul 27 09:45:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:45:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] No VIF found with MAC fa:16:3e:f0:68:ae, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:45:41 user nova-compute[70374]: DEBUG nova.network.neutron [req-7fa625b2-7d03-41dc-9a63-865c6b058e89 req-34c5a31d-ee5d-4be8-84a5-0c91e94095b4 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Updated VIF entry in instance network info cache for port 0a8fa314-033f-4fd4-b6b9-eae84b9e59e1. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:45:41 user nova-compute[70374]: DEBUG nova.network.neutron [req-7fa625b2-7d03-41dc-9a63-865c6b058e89 req-34c5a31d-ee5d-4be8-84a5-0c91e94095b4 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Updating instance_info_cache with network_info: [{"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:45:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7fa625b2-7d03-41dc-9a63-865c6b058e89 req-34c5a31d-ee5d-4be8-84a5-0c91e94095b4 service nova] Releasing lock "refresh_cache-fe923721-b4e2-4735-823f-dae34d703018" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:45:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-87488093-586f-4f88-b762-e29c59e6a233 req-cccfd78f-f0aa-43c0-92b2-dd27747d2f5e service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received event network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87488093-586f-4f88-b762-e29c59e6a233 req-cccfd78f-f0aa-43c0-92b2-dd27747d2f5e service nova] Acquiring lock "fe923721-b4e2-4735-823f-dae34d703018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87488093-586f-4f88-b762-e29c59e6a233 req-cccfd78f-f0aa-43c0-92b2-dd27747d2f5e service nova] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87488093-586f-4f88-b762-e29c59e6a233 req-cccfd78f-f0aa-43c0-92b2-dd27747d2f5e service nova] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-87488093-586f-4f88-b762-e29c59e6a233 req-cccfd78f-f0aa-43c0-92b2-dd27747d2f5e service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] No waiting events found dispatching network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:45:42 user nova-compute[70374]: WARNING nova.compute.manager [req-87488093-586f-4f88-b762-e29c59e6a233 req-cccfd78f-f0aa-43c0-92b2-dd27747d2f5e service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received unexpected event network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 for instance with vm_state building and task_state spawning.
Jul 27 09:45:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451144.816799, fe923721-b4e2-4735-823f-dae34d703018 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:45:44 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] VM Resumed (Lifecycle Event)
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:45:44 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: fe923721-b4e2-4735-823f-dae34d703018] Instance spawned successfully.
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:45:44 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451144.8175764, fe923721-b4e2-4735-823f-dae34d703018 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:45:44 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] VM Started (Lifecycle Event)
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-f1cd428d-0f09-4f7e-ab67-3cf04bb5361b req-f8309635-e9ef-408a-a123-2590fd8b1e11 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received event network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f1cd428d-0f09-4f7e-ab67-3cf04bb5361b req-f8309635-e9ef-408a-a123-2590fd8b1e11 service nova] Acquiring lock "fe923721-b4e2-4735-823f-dae34d703018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f1cd428d-0f09-4f7e-ab67-3cf04bb5361b req-f8309635-e9ef-408a-a123-2590fd8b1e11 service nova] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f1cd428d-0f09-4f7e-ab67-3cf04bb5361b req-f8309635-e9ef-408a-a123-2590fd8b1e11 service nova] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-f1cd428d-0f09-4f7e-ab67-3cf04bb5361b req-f8309635-e9ef-408a-a123-2590fd8b1e11 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] No waiting events found dispatching network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:45:44 user nova-compute[70374]: WARNING nova.compute.manager [req-f1cd428d-0f09-4f7e-ab67-3cf04bb5361b req-f8309635-e9ef-408a-a123-2590fd8b1e11 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received unexpected event network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 for instance with vm_state building and task_state spawning.
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:45:44 user nova-compute[70374]: INFO nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Took 6.65 seconds to spawn the instance on the hypervisor.
Jul 27 09:45:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:45:44 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:45:45 user nova-compute[70374]: INFO nova.compute.manager [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Took 7.62 seconds to build instance.
Jul 27 09:45:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7291e890-dabc-4ef7-8193-09d6d67b9b8f tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "fe923721-b4e2-4735-823f-dae34d703018" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.740s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:53 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'flavor' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:45:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:45:54 user nova-compute[70374]: INFO nova.compute.manager [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Attaching volume c6bc10fe-eff6-493c-be2c-90b8af41d462 to /dev/vdb
Jul 27 09:45:54 user nova-compute[70374]: DEBUG os_brick.utils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[954fa3d0-f4b3-4bfa-bf54-b0aa919bf32e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ad1dc-5bc6-40b6-97da-e4407b634f21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04c125-6069-484f-bc9b-df0a8221448e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bbbe0e-2ff9-4195-8826-bdc5be1ae74b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:45:54 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:45:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf470953-8c0b-4d99-b18e-6d5578a78b54]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG os_brick.utils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:45:54 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating existing volume attachment record: cbb83de8-77a4-45fc-adb5-c42f046fe307 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:45:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:45:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:46:01 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:46:01 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:46:01 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[970df96c-15b8-4baf-b4cc-8f9b4064b4c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:46:01 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[78af2fd2-fca2-459b-b6eb-c090b5cf3b44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462] added
Jul 27 09:46:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5df65f-371d-49da-916e-3227bf973966]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cb8f35-7119-40ff-9151-2d98a60b7f29]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWKERxAS {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWKERxAS" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[358b6b5f-85dd-4866-a18d-63ed27895004]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWKERxAS'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fdd10e-e729-4099-851f-5191d798a9b0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19f6517-74a2-407a-bccf-c3dc2ba42cb9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bec722-220a-4afa-8913-7fb7a6db618b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]
Jul 27 09:46:01 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.
Jul 27 09:46:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ac9d5-ed39-4d70-8d3f-03bb328ed6bb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34454dc-fae9-4b3e-a8e9-9975d82cb30b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:01 user nova-compute[70374]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:01 user nova-compute[70374]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a571ef03-fefe-4ea4-89c5-18927219b3d0]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:46:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:46:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:46:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26333666432306134', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:46:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333666432306134', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:46:02 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'flavor' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:46:03 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:46:03 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:46:03 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:46:03 user nova-compute[70374]:   <serial>c6bc10fe-eff6-493c-be2c-90b8af41d462</serial>
Jul 27 09:46:03 user nova-compute[70374]: </disk>
Jul 27 09:46:03 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:46:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:46:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:46:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] No VIF found with MAC fa:16:3e:d1:c6:60, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:46:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6e37897e-4f8b-4058-8d6a-3215f7368ed7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.467s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Stashing vm_state: active {{(pid=70374) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'pci_requests' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:46:06 user nova-compute[70374]: INFO nova.compute.claims [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Claim successful on node user
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'resources' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'pci_devices' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:06 user nova-compute[70374]: INFO nova.compute.resource_tracker [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating resource usage from migration 449efb11-c37b-41f6-82c8-f91156492cfd
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.390s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:06 user nova-compute[70374]: INFO nova.compute.manager [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Migrating
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:46:06 user nova-compute[70374]: INFO nova.compute.rpcapi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:46:06 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Starting migrate_disk_and_power_off {{(pid=70374) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-9dbd343c-e4b0-46e5-940d-3d4cca821762 req-b47f48c0-d69a-48b0-bb3e-426e974e1ecd service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9dbd343c-e4b0-46e5-940d-3d4cca821762 req-b47f48c0-d69a-48b0-bb3e-426e974e1ecd service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9dbd343c-e4b0-46e5-940d-3d4cca821762 req-b47f48c0-d69a-48b0-bb3e-426e974e1ecd service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9dbd343c-e4b0-46e5-940d-3d4cca821762 req-b47f48c0-d69a-48b0-bb3e-426e974e1ecd service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-9dbd343c-e4b0-46e5-940d-3d4cca821762 req-b47f48c0-d69a-48b0-bb3e-426e974e1ecd service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:07 user nova-compute[70374]: WARNING nova.compute.manager [req-9dbd343c-e4b0-46e5-940d-3d4cca821762 req-b47f48c0-d69a-48b0-bb3e-426e974e1ecd service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state active and task_state resize_migrating.
Jul 27 09:46:08 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance destroyed successfully.
Jul 27 09:46:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-199628034-network", "vif_mac": "fa:16:3e:d1:c6:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-199628034-network", "vif_mac": "fa:16:3e:d1:c6:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_vif [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad798508-82, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:08 user nova-compute[70374]: INFO os_vif [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82')
Jul 27 09:46:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:46:08 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b408dd5-ded6-445e-a769-5df4a3b1de3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:46:08 user nova-compute[70374]: No targets found.
Jul 27 09:46:08 user nova-compute[70374]: iSNS:
Jul 27 09:46:08 user nova-compute[70374]: No targets found.
Jul 27 09:46:08 user nova-compute[70374]: STATIC:
Jul 27 09:46:08 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428
Jul 27 09:46:08 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:46:08 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:46:08 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462
Jul 27 09:46:08 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:46:08 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:46:08 user nova-compute[70374]: FIRMWARE:
Jul 27 09:46:08 user nova-compute[70374]: No targets found.
Jul 27 09:46:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:46:08 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:46:08 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bbaba8-2186-4865-a927-35ab7cc34ca0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04edd42-5757-4309-a7b6-d57e62ebb221]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:08 user nova-compute[70374]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:08 user nova-compute[70374]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5f0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f90b7-eea4-4a74-8dae-2cd4a3c0346b]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22d2880-2e96-4e89-86bf-110aafbe1f6d]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73a00bd-c10f-4e73-9b5d-deeb0f5bee2e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aafbe3-f947-476f-8315-e3a89be7d5f1]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaf88e2-0ac1-45b9-80f1-570c395c7459]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6d240-77ca-423b-b3fc-1e3d0b5dc4cd]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]
Jul 27 09:46:08 user nova-compute[70374]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.
Jul 27 09:46:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71f5cef-f401-42b8-948c-bc04a2d90726]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== disconnect_volume: return (299ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:46:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee_resize/disk /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "cp -r /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee_resize/disk /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk" returned: 0 in 0.430s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee_resize/disk.info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk.info {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:09 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "cp -r /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee_resize/disk.info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk.info" returned: 0 in 0.040s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-a59d1276-d6b3-4c22-9d54-c0c18e80a2b4 req-f7071660-48aa-4042-a62e-883eecff176f service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a59d1276-d6b3-4c22-9d54-c0c18e80a2b4 req-f7071660-48aa-4042-a62e-883eecff176f service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a59d1276-d6b3-4c22-9d54-c0c18e80a2b4 req-f7071660-48aa-4042-a62e-883eecff176f service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a59d1276-d6b3-4c22-9d54-c0c18e80a2b4 req-f7071660-48aa-4042-a62e-883eecff176f service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-a59d1276-d6b3-4c22-9d54-c0c18e80a2b4 req-f7071660-48aa-4042-a62e-883eecff176f service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:09 user nova-compute[70374]: WARNING nova.compute.manager [req-a59d1276-d6b3-4c22-9d54-c0c18e80a2b4 req-f7071660-48aa-4042-a62e-883eecff176f service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state active and task_state resize_migrating.
Jul 27 09:46:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Port ad798508-8253-45fd-874b-abfa6dc1b966 binding to destination host user is already ACTIVE {{(pid=70374) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 09:46:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:46:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:46:10 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG os_brick.utils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a47ee2-8338-4308-8a39-a28030460e95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d401811-a917-4eec-a9f5-69797adea517]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[05795532-1849-465f-a57a-5695bfca73e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[290a7164-57d4-4693-b835-356c4977cfbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:46:11 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:46:11 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba65665-86dc-4e69-9610-e9246b5773d5]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:46:11 user nova-compute[70374]: DEBUG os_brick.utils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:46:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:46:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:15 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:46:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:46:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:46:15 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:46:16 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:46:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:46:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:46:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Starting finish_migration {{(pid=70374) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance directory exists: not creating {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 09:46:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Creating image(s)
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'trusted_certs' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk. size=21474836480 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk 21474836480 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk 21474836480" returned: 0 in 0.056s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Ensure instance console log exists: /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Start _get_guest_xml network_info=[{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-199628034-network", "vif_mac": "fa:16:3e:d1:c6:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '383365d6-def2-4f14-a10e-e0f96c76cb38', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee', 'attached_at': '2023-07-27T09:46:19.000000', 'detached_at': '', 'volume_id': 'c6bc10fe-eff6-493c-be2c-90b8af41d462', 'serial': 'c6bc10fe-eff6-493c-be2c-90b8af41d462'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:19 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:46:19 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'vcpu_model' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:46:19 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:46:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:46:19 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:46:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:46:19 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[40821e67-11fa-42d2-906b-cd7982850b75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:46:19 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf332f-bc72-4ed6-ac04-7959235ab7c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462] added
Jul 27 09:46:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.077s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c37ad96-0f6b-4aaf-99e7-28889051c7ce]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88e41d9-57c4-431c-ab36-545620bce10b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWKERxAS {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWKERxAS" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c560ee-2df0-459e-b3fa-5afab413180b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWKERxAS'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8cf6d9-5c37-491a-bc9f-07f9764b9e4d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ac0831-004b-468f-8d63-4e0b330ce67f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e356f95-d2b8-4abe-ace0-91f43b6a202d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]
Jul 27 09:46:20 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.
Jul 27 09:46:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[550354e3-5573-48f9-b503-78fb1dd78373]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d801f7-d5ac-46dd-bd5d-22833c30f2bb]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:20 user nova-compute[70374]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:20 user nova-compute[70374]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0245f12b-681c-43c4-b956-97a1e0011ef4]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '26333666432306134', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333666432306134', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:46:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-199628034-network", "vif_mac": "fa:16:3e:d1:c6:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-199628034-network", "vif_mac": "fa:16:3e:d1:c6:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:46:21 user nova-compute[70374]:   <uuid>bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</uuid>
Jul 27 09:46:21 user nova-compute[70374]:   <name>instance-0000001f</name>
Jul 27 09:46:21 user nova-compute[70374]:   <memory>2097152</memory>
Jul 27 09:46:21 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:46:21 user nova-compute[70374]:   <metadata>
Jul 27 09:46:21 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:46:21 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:46:21 user nova-compute[70374]:       <nova:name>tempest-ServerActionsTestOtherB-server-320285733</nova:name>
Jul 27 09:46:21 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:46:19</nova:creationTime>
Jul 27 09:46:21 user nova-compute[70374]:       <nova:flavor name="m1.small">
Jul 27 09:46:21 user nova-compute[70374]:         <nova:memory>2048</nova:memory>
Jul 27 09:46:21 user nova-compute[70374]:         <nova:disk>20</nova:disk>
Jul 27 09:46:21 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:46:21 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:46:21 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:46:21 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:46:21 user nova-compute[70374]:       <nova:owner>
Jul 27 09:46:21 user nova-compute[70374]:         <nova:user uuid="906960beba9548c1b0bfb37011957bd7">tempest-ServerActionsTestOtherB-247493366-project-member</nova:user>
Jul 27 09:46:21 user nova-compute[70374]:         <nova:project uuid="6457496dd4d54638a58c4e731420e473">tempest-ServerActionsTestOtherB-247493366</nova:project>
Jul 27 09:46:21 user nova-compute[70374]:       </nova:owner>
Jul 27 09:46:21 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:46:21 user nova-compute[70374]:       <nova:ports>
Jul 27 09:46:21 user nova-compute[70374]:         <nova:port uuid="ad798508-8253-45fd-874b-abfa6dc1b966">
Jul 27 09:46:21 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 09:46:21 user nova-compute[70374]:         </nova:port>
Jul 27 09:46:21 user nova-compute[70374]:       </nova:ports>
Jul 27 09:46:21 user nova-compute[70374]:     </nova:instance>
Jul 27 09:46:21 user nova-compute[70374]:   </metadata>
Jul 27 09:46:21 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:46:21 user nova-compute[70374]:     <system>
Jul 27 09:46:21 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:46:21 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:46:21 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:46:21 user nova-compute[70374]:       <entry name="serial">bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</entry>
Jul 27 09:46:21 user nova-compute[70374]:       <entry name="uuid">bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</entry>
Jul 27 09:46:21 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:46:21 user nova-compute[70374]:     </system>
Jul 27 09:46:21 user nova-compute[70374]:   </sysinfo>
Jul 27 09:46:21 user nova-compute[70374]:   <os>
Jul 27 09:46:21 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:46:21 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:46:21 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:46:21 user nova-compute[70374]:   </os>
Jul 27 09:46:21 user nova-compute[70374]:   <features>
Jul 27 09:46:21 user nova-compute[70374]:     <acpi/>
Jul 27 09:46:21 user nova-compute[70374]:     <apic/>
Jul 27 09:46:21 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:46:21 user nova-compute[70374]:   </features>
Jul 27 09:46:21 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:46:21 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:46:21 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:46:21 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:46:21 user nova-compute[70374]:   </clock>
Jul 27 09:46:21 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:46:21 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:46:21 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:46:21 user nova-compute[70374]:   </cpu>
Jul 27 09:46:21 user nova-compute[70374]:   <devices>
Jul 27 09:46:21 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:46:21 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:46:21 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk"/>
Jul 27 09:46:21 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:46:21 user nova-compute[70374]:     </disk>
Jul 27 09:46:21 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:46:21 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:46:21 user nova-compute[70374]:       <source dev="/dev/sdc"/>
Jul 27 09:46:21 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:46:21 user nova-compute[70374]:       <serial>c6bc10fe-eff6-493c-be2c-90b8af41d462</serial>
Jul 27 09:46:21 user nova-compute[70374]:     </disk>
Jul 27 09:46:21 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:46:21 user nova-compute[70374]:       <mac address="fa:16:3e:d1:c6:60"/>
Jul 27 09:46:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:46:21 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:46:21 user nova-compute[70374]:       <target dev="tapad798508-82"/>
Jul 27 09:46:21 user nova-compute[70374]:     </interface>
Jul 27 09:46:21 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:46:21 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/console.log" append="off"/>
Jul 27 09:46:21 user nova-compute[70374]:     </serial>
Jul 27 09:46:21 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:46:21 user nova-compute[70374]:     <video>
Jul 27 09:46:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:46:21 user nova-compute[70374]:     </video>
Jul 27 09:46:21 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:46:21 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:46:21 user nova-compute[70374]:     </rng>
Jul 27 09:46:21 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:46:21 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:46:21 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:46:21 user nova-compute[70374]:     </memballoon>
Jul 27 09:46:21 user nova-compute[70374]:   </devices>
Jul 27 09:46:21 user nova-compute[70374]: </domain>
Jul 27 09:46:21 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:46:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-199628034-network", "vif_mac": "fa:16:3e:d1:c6:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-199628034-network", "vif_mac": "fa:16:3e:d1:c6:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG os_vif [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad798508-82, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad798508-82, col_values=(('external_ids', {'iface-id': 'ad798508-8253-45fd-874b-abfa6dc1b966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:c6:60', 'vm-uuid': 'bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:21 user nova-compute[70374]: INFO os_vif [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82')
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] No VIF found with MAC fa:16:3e:d1:c6:60, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:46:22 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:46:22 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8095MB free_disk=25.39276885986328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Applying migration context for instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee as it has an incoming, in-progress migration 449efb11-c37b-41f6-82c8-f91156492cfd. Migration status is post-migrating {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 09:46:22 user nova-compute[70374]: INFO nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating resource usage from migration 449efb11-c37b-41f6-82c8-f91156492cfd
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 56ab07d0-823d-4282-bdc5-21910c33678a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fe923721-b4e2-4735-823f-dae34d703018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Migration 449efb11-c37b-41f6-82c8-f91156492cfd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451168.2172234, bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:46:23 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] VM Stopped (Lifecycle Event)
Jul 27 09:46:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-e173fb94-7d69-44d5-9f29-614607e70879 req-91c0d641-26c6-482c-bdd3-45599ce69a31 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e173fb94-7d69-44d5-9f29-614607e70879 req-91c0d641-26c6-482c-bdd3-45599ce69a31 service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e173fb94-7d69-44d5-9f29-614607e70879 req-91c0d641-26c6-482c-bdd3-45599ce69a31 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e173fb94-7d69-44d5-9f29-614607e70879 req-91c0d641-26c6-482c-bdd3-45599ce69a31 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-e173fb94-7d69-44d5-9f29-614607e70879 req-91c0d641-26c6-482c-bdd3-45599ce69a31 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:23 user nova-compute[70374]: WARNING nova.compute.manager [req-e173fb94-7d69-44d5-9f29-614607e70879 req-91c0d641-26c6-482c-bdd3-45599ce69a31 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state active and task_state resize_finish.
Jul 27 09:46:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f43b0cf4-f4a3-42d1-8f07-352c7863d5d7 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451185.1423922, bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:46:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] VM Resumed (Lifecycle Event)
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:46:25 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance running successfully.
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Failed to set time: agent not configured {{(pid=70374) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7663992-e802-4966-9871-8853286bcda7 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] finish_migration finished successfully. {{(pid=70374) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451185.1441746, bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:46:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] VM Started (Lifecycle Event)
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:46:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 09:46:25 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-32c542a0-0764-4393-8b16-42dcc04761c0 req-84e13810-666c-4c22-b9d5-877154431407 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-32c542a0-0764-4393-8b16-42dcc04761c0 req-84e13810-666c-4c22-b9d5-877154431407 service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-32c542a0-0764-4393-8b16-42dcc04761c0 req-84e13810-666c-4c22-b9d5-877154431407 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-32c542a0-0764-4393-8b16-42dcc04761c0 req-84e13810-666c-4c22-b9d5-877154431407 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-32c542a0-0764-4393-8b16-42dcc04761c0 req-84e13810-666c-4c22-b9d5-877154431407 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:25 user nova-compute[70374]: WARNING nova.compute.manager [req-32c542a0-0764-4393-8b16-42dcc04761c0 req-84e13810-666c-4c22-b9d5-877154431407 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state active and task_state resize_finish.
Jul 27 09:46:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:31 user nova-compute[70374]: INFO nova.compute.manager [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Terminating instance
Jul 27 09:46:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-c3b00404-09df-4497-a838-028cd15b7b42 req-e2c2918e-7b2c-4a81-9a1a-fec22fa3a477 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-unplugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c3b00404-09df-4497-a838-028cd15b7b42 req-e2c2918e-7b2c-4a81-9a1a-fec22fa3a477 service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c3b00404-09df-4497-a838-028cd15b7b42 req-e2c2918e-7b2c-4a81-9a1a-fec22fa3a477 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c3b00404-09df-4497-a838-028cd15b7b42 req-e2c2918e-7b2c-4a81-9a1a-fec22fa3a477 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-c3b00404-09df-4497-a838-028cd15b7b42 req-e2c2918e-7b2c-4a81-9a1a-fec22fa3a477 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-unplugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-c3b00404-09df-4497-a838-028cd15b7b42 req-e2c2918e-7b2c-4a81-9a1a-fec22fa3a477 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-unplugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Instance destroyed successfully.
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.objects.instance [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'resources' on Instance uuid 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457979026',display_name='tempest-ServerRescueNegativeTestJSON-server-1457979026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457979026',id=4,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:32:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-x508h1z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:32:09Z,user_data=None,user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=6ae93f34-ce7e-4ae4-a5ba-36508361bd54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "ce2809b5-cc30-4a29-9770-7df186b16406", "address": "fa:16:3e:ef:0f:b2", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2809b5-cc", "ovs_interfaceid": "ce2809b5-cc30-4a29-9770-7df186b16406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:0f:b2,bridge_name='br-int',has_traffic_filtering=True,id=ce2809b5-cc30-4a29-9770-7df186b16406,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2809b5-cc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG os_vif [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:0f:b2,bridge_name='br-int',has_traffic_filtering=True,id=ce2809b5-cc30-4a29-9770-7df186b16406,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2809b5-cc') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce2809b5-cc, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:46:32 user nova-compute[70374]: INFO os_vif [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:0f:b2,bridge_name='br-int',has_traffic_filtering=True,id=ce2809b5-cc30-4a29-9770-7df186b16406,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2809b5-cc')
Jul 27 09:46:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Deleting instance files /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54_del
Jul 27 09:46:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Deletion of /opt/stack/data/nova/instances/6ae93f34-ce7e-4ae4-a5ba-36508361bd54_del complete
Jul 27 09:46:32 user nova-compute[70374]: INFO nova.compute.manager [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Took 0.97 seconds to destroy the instance on the hypervisor.
Jul 27 09:46:32 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:33 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:46:33 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Took 0.74 seconds to deallocate network for instance.
Jul 27 09:46:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:33 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:46:33 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:46:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:34 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Deleted allocations for instance 6ae93f34-ce7e-4ae4-a5ba-36508361bd54
Jul 27 09:46:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-3baff908-213c-4301-9673-333d627e510d req-7737de73-4bcb-429b-b5c6-212b1578cf35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-deleted-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3d9e4b26-1e12-4bbf-bda0-284454a1a91b tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.237s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:34 user nova-compute[70374]: WARNING nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state deleted and task_state None.
Jul 27 09:46:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:34 user nova-compute[70374]: WARNING nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state deleted and task_state None.
Jul 27 09:46:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Acquiring lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] Lock "6ae93f34-ce7e-4ae4-a5ba-36508361bd54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] No waiting events found dispatching network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:34 user nova-compute[70374]: WARNING nova.compute.manager [req-f2d4ba3d-af19-4e10-a53f-8e4c02a4b0b1 req-30edbebb-8993-46f3-b135-1de27ba22c35 service nova] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Received unexpected event network-vif-plugged-ce2809b5-cc30-4a29-9770-7df186b16406 for instance with vm_state deleted and task_state None.
Jul 27 09:46:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_power_states {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid fe923721-b4e2-4735-823f-dae34d703018 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "fe923721-b4e2-4735-823f-dae34d703018" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "fe923721-b4e2-4735-823f-dae34d703018" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "fe923721-b4e2-4735-823f-dae34d703018" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:46:40 user nova-compute[70374]: INFO nova.compute.claims [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Claim successful on node user
Jul 27 09:46:40 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG nova.network.neutron [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:46:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:46:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:46:41 user nova-compute[70374]: INFO nova.virt.block_device [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Booting with volume 07b4a7fb-6c06-4202-b289-a51813df1401 at /dev/vda
Jul 27 09:46:41 user nova-compute[70374]: DEBUG nova.policy [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2b416973f744369818b2a67bcecdeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06bd4d4e7144fbc99c907fb405b7e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG os_brick.utils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac05a516-4818-45a1-814c-31a95a38f1ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cde51d-0c1e-48f4-b89e-0e0b129f92be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[934445cd-d7c2-4f51-a8ca-2b605c689ab3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0143b44-fe16-4c83-9e32-d6ce5e6e56c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:46:41 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:46:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[392a6742-47db-403c-980a-f3d8a67c3a22]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG os_brick.utils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating existing volume attachment record: c020588e-8b69-4be5-9386-3287c81f21e3 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:46:41 user nova-compute[70374]: DEBUG nova.network.neutron [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Successfully created port: 8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Successfully updated port: 8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquired lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-3a089047-9abe-4282-b014-9caaa68fc0c4 req-9353fa15-a158-4b73-8745-7b6b83a407f1 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-changed-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-3a089047-9abe-4282-b014-9caaa68fc0c4 req-9353fa15-a158-4b73-8745-7b6b83a407f1 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Refreshing instance network info cache due to event network-changed-8688b83f-7507-454f-8b59-2a3293ca896d. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a089047-9abe-4282-b014-9caaa68fc0c4 req-9353fa15-a158-4b73-8745-7b6b83a407f1 service nova] Acquiring lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:46:43 user nova-compute[70374]: DEBUG nova.network.neutron [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:46:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Releasing lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:46:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance network_info: |[{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:46:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a089047-9abe-4282-b014-9caaa68fc0c4 req-9353fa15-a158-4b73-8745-7b6b83a407f1 service nova] Acquired lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:46:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-3a089047-9abe-4282-b014-9caaa68fc0c4 req-9353fa15-a158-4b73-8745-7b6b83a407f1 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Refreshing network info cache for port 8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:46:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-3a089047-9abe-4282-b014-9caaa68fc0c4 req-9353fa15-a158-4b73-8745-7b6b83a407f1 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updated VIF entry in instance network info cache for port 8688b83f-7507-454f-8b59-2a3293ca896d. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:46:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-3a089047-9abe-4282-b014-9caaa68fc0c4 req-9353fa15-a158-4b73-8745-7b6b83a407f1 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:46:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a089047-9abe-4282-b014-9caaa68fc0c4 req-9353fa15-a158-4b73-8745-7b6b83a407f1 service nova] Releasing lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:46:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:47 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451192.7534654, 6ae93f34-ce7e-4ae4-a5ba-36508361bd54 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:46:47 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] VM Stopped (Lifecycle Event)
Jul 27 09:46:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a43d6efd-fd45-48c7-b932-65579e774eb4 None None] [instance: 6ae93f34-ce7e-4ae4-a5ba-36508361bd54] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:46:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:46:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Creating image(s)
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Ensure instance console log exists: /opt/stack/data/nova/instances/931b15c3-29a5-4b70-92d0-4c22fc1b9303/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Start _get_guest_xml network_info=[{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'c020588e-8b69-4be5-9386-3287c81f21e3', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXFjoRIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '931b15c3-29a5-4b70-92d0-4c22fc1b9303', 'attached_at': '', 'detached_at': '', 'volume_id': '07b4a7fb-6c06-4202-b289-a51813df1401', 'serial': '07b4a7fb-6c06-4202-b289-a51813df1401'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:46:48 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:46:48 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXFjoRIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:46:48 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:46:48 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:46:48 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda63a9-d4bc-44ea-9d07-725f850e0f06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:46:48 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d10c122-3a83-4014-ae24-32e458339eef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401] added
Jul 27 09:46:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c0e822-6687-4bf8-aae6-111254afbad8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b0967-e60c-4af7-97f8-550783c65b03]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXFjoRIa {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXFjoRIa" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[df949790-7d04-4a2b-8f5e-63a76993a185]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXFjoRIa'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[96baf20e-5641-43bf-adb6-79bbd4e0be66]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe84ad4b-21cc-48a0-8b26-0ceb3bffc82f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96bc19b-feeb-4ee4-8c36-1413f64e5a78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260]
Jul 27 09:46:48 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260] successful.
Jul 27 09:46:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[21934b7c-8d83-404d-b564-1aaede513da8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1305034d-18b0-49f7-bb4b-1e730501854a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:46:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ffe30c-df4f-4d17-87d6-f870f85f25d4]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:46:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXFjoRIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23939316332346330', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939316332346330', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1415728061',display_name='tempest-ServerActionsTestOtherA-server-1415728061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1415728061',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-ym8no9e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=931b15c3-29a5-4b70-92d0-4c22fc1b9303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'pci_devices' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:46:49 user nova-compute[70374]:   <uuid>931b15c3-29a5-4b70-92d0-4c22fc1b9303</uuid>
Jul 27 09:46:49 user nova-compute[70374]:   <name>instance-00000022</name>
Jul 27 09:46:49 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:46:49 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:46:49 user nova-compute[70374]:   <metadata>
Jul 27 09:46:49 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:46:49 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:46:49 user nova-compute[70374]:       <nova:name>tempest-ServerActionsTestOtherA-server-1415728061</nova:name>
Jul 27 09:46:49 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:46:48</nova:creationTime>
Jul 27 09:46:49 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:46:49 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:46:49 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:46:49 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:46:49 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:46:49 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:46:49 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:46:49 user nova-compute[70374]:       <nova:owner>
Jul 27 09:46:49 user nova-compute[70374]:         <nova:user uuid="a2b416973f744369818b2a67bcecdeb9">tempest-ServerActionsTestOtherA-2053926798-project-member</nova:user>
Jul 27 09:46:49 user nova-compute[70374]:         <nova:project uuid="f06bd4d4e7144fbc99c907fb405b7e99">tempest-ServerActionsTestOtherA-2053926798</nova:project>
Jul 27 09:46:49 user nova-compute[70374]:       </nova:owner>
Jul 27 09:46:49 user nova-compute[70374]:       <nova:ports>
Jul 27 09:46:49 user nova-compute[70374]:         <nova:port uuid="8688b83f-7507-454f-8b59-2a3293ca896d">
Jul 27 09:46:49 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 09:46:49 user nova-compute[70374]:         </nova:port>
Jul 27 09:46:49 user nova-compute[70374]:       </nova:ports>
Jul 27 09:46:49 user nova-compute[70374]:     </nova:instance>
Jul 27 09:46:49 user nova-compute[70374]:   </metadata>
Jul 27 09:46:49 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:46:49 user nova-compute[70374]:     <system>
Jul 27 09:46:49 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:46:49 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:46:49 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:46:49 user nova-compute[70374]:       <entry name="serial">931b15c3-29a5-4b70-92d0-4c22fc1b9303</entry>
Jul 27 09:46:49 user nova-compute[70374]:       <entry name="uuid">931b15c3-29a5-4b70-92d0-4c22fc1b9303</entry>
Jul 27 09:46:49 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:46:49 user nova-compute[70374]:     </system>
Jul 27 09:46:49 user nova-compute[70374]:   </sysinfo>
Jul 27 09:46:49 user nova-compute[70374]:   <os>
Jul 27 09:46:49 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:46:49 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:46:49 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:46:49 user nova-compute[70374]:   </os>
Jul 27 09:46:49 user nova-compute[70374]:   <features>
Jul 27 09:46:49 user nova-compute[70374]:     <acpi/>
Jul 27 09:46:49 user nova-compute[70374]:     <apic/>
Jul 27 09:46:49 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:46:49 user nova-compute[70374]:   </features>
Jul 27 09:46:49 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:46:49 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:46:49 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:46:49 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:46:49 user nova-compute[70374]:   </clock>
Jul 27 09:46:49 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:46:49 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:46:49 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:46:49 user nova-compute[70374]:   </cpu>
Jul 27 09:46:49 user nova-compute[70374]:   <devices>
Jul 27 09:46:49 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:46:49 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:46:49 user nova-compute[70374]:       <source dev="/dev/sdd"/>
Jul 27 09:46:49 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:46:49 user nova-compute[70374]:       <serial>07b4a7fb-6c06-4202-b289-a51813df1401</serial>
Jul 27 09:46:49 user nova-compute[70374]:     </disk>
Jul 27 09:46:49 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:46:49 user nova-compute[70374]:       <mac address="fa:16:3e:5c:df:ee"/>
Jul 27 09:46:49 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:46:49 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:46:49 user nova-compute[70374]:       <target dev="tap8688b83f-75"/>
Jul 27 09:46:49 user nova-compute[70374]:     </interface>
Jul 27 09:46:49 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:46:49 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/931b15c3-29a5-4b70-92d0-4c22fc1b9303/console.log" append="off"/>
Jul 27 09:46:49 user nova-compute[70374]:     </serial>
Jul 27 09:46:49 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:46:49 user nova-compute[70374]:     <video>
Jul 27 09:46:49 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:46:49 user nova-compute[70374]:     </video>
Jul 27 09:46:49 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:46:49 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:46:49 user nova-compute[70374]:     </rng>
Jul 27 09:46:49 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:46:49 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:46:49 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:46:49 user nova-compute[70374]:     </memballoon>
Jul 27 09:46:49 user nova-compute[70374]:   </devices>
Jul 27 09:46:49 user nova-compute[70374]: </domain>
Jul 27 09:46:49 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1415728061',display_name='tempest-ServerActionsTestOtherA-server-1415728061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1415728061',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-ym8no9e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=931b15c3-29a5-4b70-92d0-4c22fc1b9303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG os_vif [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8688b83f-75, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8688b83f-75, col_values=(('external_ids', {'iface-id': '8688b83f-7507-454f-8b59-2a3293ca896d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:df:ee', 'vm-uuid': '931b15c3-29a5-4b70-92d0-4c22fc1b9303'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:49 user nova-compute[70374]: INFO os_vif [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75')
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:46:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No VIF found with MAC fa:16:3e:5c:df:ee, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:46:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-9f4d467d-7660-40c9-8d92-ec20e7f06c23 req-241cc0a1-f721-4988-a5ee-e3d6f757b12d service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9f4d467d-7660-40c9-8d92-ec20e7f06c23 req-241cc0a1-f721-4988-a5ee-e3d6f757b12d service nova] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9f4d467d-7660-40c9-8d92-ec20e7f06c23 req-241cc0a1-f721-4988-a5ee-e3d6f757b12d service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9f4d467d-7660-40c9-8d92-ec20e7f06c23 req-241cc0a1-f721-4988-a5ee-e3d6f757b12d service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-9f4d467d-7660-40c9-8d92-ec20e7f06c23 req-241cc0a1-f721-4988-a5ee-e3d6f757b12d service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] No waiting events found dispatching network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:51 user nova-compute[70374]: WARNING nova.compute.manager [req-9f4d467d-7660-40c9-8d92-ec20e7f06c23 req-241cc0a1-f721-4988-a5ee-e3d6f757b12d service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received unexpected event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d for instance with vm_state building and task_state spawning.
Jul 27 09:46:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451213.1859145, 931b15c3-29a5-4b70-92d0-4c22fc1b9303 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:46:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] VM Resumed (Lifecycle Event)
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:46:53 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance spawned successfully.
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:46:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451213.1873782, 931b15c3-29a5-4b70-92d0-4c22fc1b9303 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:46:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] VM Started (Lifecycle Event)
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:46:53 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:46:53 user nova-compute[70374]: INFO nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Took 4.92 seconds to spawn the instance on the hypervisor.
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-d83232b0-3003-4add-b6d4-1fbc892b8382 req-8138db90-a155-4200-a042-c67f050f3cda service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d83232b0-3003-4add-b6d4-1fbc892b8382 req-8138db90-a155-4200-a042-c67f050f3cda service nova] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d83232b0-3003-4add-b6d4-1fbc892b8382 req-8138db90-a155-4200-a042-c67f050f3cda service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d83232b0-3003-4add-b6d4-1fbc892b8382 req-8138db90-a155-4200-a042-c67f050f3cda service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-d83232b0-3003-4add-b6d4-1fbc892b8382 req-8138db90-a155-4200-a042-c67f050f3cda service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] No waiting events found dispatching network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:46:53 user nova-compute[70374]: WARNING nova.compute.manager [req-d83232b0-3003-4add-b6d4-1fbc892b8382 req-8138db90-a155-4200-a042-c67f050f3cda service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received unexpected event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d for instance with vm_state building and task_state spawning.
Jul 27 09:46:53 user nova-compute[70374]: INFO nova.compute.manager [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Took 12.71 seconds to build instance.
Jul 27 09:46:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-39a4ac83-f8e0-4543-bcc1-72bf3bee10d2 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.813s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:46:57 user nova-compute[70374]: INFO nova.compute.manager [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Detaching volume 8400992d-ab79-4e63-9044-f5cf9f27a428
Jul 27 09:46:57 user nova-compute[70374]: INFO nova.virt.block_device [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Attempting to driver detach volume 8400992d-ab79-4e63-9044-f5cf9f27a428 from mountpoint /dev/vdc
Jul 27 09:46:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Attempting to detach device vdc from instance 56ab07d0-823d-4282-bdc5-21910c33678a from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:46:57 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:46:57 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:46:57 user nova-compute[70374]:   <target dev="vdc" bus="virtio"/>
Jul 27 09:46:57 user nova-compute[70374]:   <serial>8400992d-ab79-4e63-9044-f5cf9f27a428</serial>
Jul 27 09:46:57 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 09:46:57 user nova-compute[70374]: </disk>
Jul 27 09:46:57 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:46:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully detached device vdc from instance 56ab07d0-823d-4282-bdc5-21910c33678a from the persistent domain config.
Jul 27 09:46:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 56ab07d0-823d-4282-bdc5-21910c33678a from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:46:57 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:46:57 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:46:57 user nova-compute[70374]:   <target dev="vdc" bus="virtio"/>
Jul 27 09:46:57 user nova-compute[70374]:   <serial>8400992d-ab79-4e63-9044-f5cf9f27a428</serial>
Jul 27 09:46:57 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 09:46:57 user nova-compute[70374]: </disk>
Jul 27 09:46:57 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451217.6393712, 56ab07d0-823d-4282-bdc5-21910c33678a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:46:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully detached device vdc from instance 56ab07d0-823d-4282-bdc5-21910c33678a from the live domain config.
Jul 27 09:46:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCYWFJpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:46:57 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[17874491-912f-486c-a4a8-eece744e3aa3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:46:57 user nova-compute[70374]: No targets found.
Jul 27 09:46:57 user nova-compute[70374]: iSNS:
Jul 27 09:46:57 user nova-compute[70374]: No targets found.
Jul 27 09:46:57 user nova-compute[70374]: STATIC:
Jul 27 09:46:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401
Jul 27 09:46:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:46:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:46:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428
Jul 27 09:46:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:46:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:46:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462
Jul 27 09:46:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:46:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:46:57 user nova-compute[70374]: FIRMWARE:
Jul 27 09:46:57 user nova-compute[70374]: No targets found.
Jul 27 09:46:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:46:57 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:46:57 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe3b78d-4283-428b-a147-259d8a5337ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d08291-a87c-41f7-9f9d-b7b3f3dea7db]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:57 user nova-compute[70374]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:57 user nova-compute[70374]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:46:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 (non-flash)
Jul 27 09:46:57 user nova-compute[70374]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:46:57 user nova-compute[70374]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:46:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc3927a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[23745069-2c96-4941-9027-e48d48c4c97f]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a39132-be09-4707-8ab1-d87742e20c13]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd368d1-abbf-41a5-8ac0-5272c4c10dc1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd5b510-33ad-49b3-86b7-af288d415c30]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[accb6bc3-2329-4dd5-a224-98f987b55113]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c11622-33d1-4113-970e-636f9a3324ad]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428, portal: 172.16.0.220,3260]
Jul 27 09:46:57 user nova-compute[70374]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428, portal: 172.16.0.220,3260] successful.
Jul 27 09:46:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8400992d-ab79-4e63-9044-f5cf9f27a428 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c77cd2-ddfe-4db8-8f41-2a291bc03ba0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] <== disconnect_volume: return (307ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:46:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:46:58 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'flavor' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:46:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3121462-75ec-409a-b385-8bbf066b4247 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:46:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:14 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:47:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:16 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:47:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:47:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:47:16 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:47:16 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:47:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:47:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:47:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:21 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:47:21 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=25.400562286376953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Applying migration context for instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee as it has an incoming, in-progress migration 449efb11-c37b-41f6-82c8-f91156492cfd. Migration status is finished {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 09:47:21 user nova-compute[70374]: INFO nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating resource usage from migration 449efb11-c37b-41f6-82c8-f91156492cfd
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 56ab07d0-823d-4282-bdc5-21910c33678a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance fe923721-b4e2-4735-823f-dae34d703018 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Migration 449efb11-c37b-41f6-82c8-f91156492cfd is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 931b15c3-29a5-4b70-92d0-4c22fc1b9303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:47:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:22 user nova-compute[70374]: INFO nova.compute.manager [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Terminating instance
Jul 27 09:47:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-56aa20c6-f17d-43cf-b77f-0b1e350a4352 req-a312c1c4-62c2-4e06-addd-db89fae3348c service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-56aa20c6-f17d-43cf-b77f-0b1e350a4352 req-a312c1c4-62c2-4e06-addd-db89fae3348c service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-56aa20c6-f17d-43cf-b77f-0b1e350a4352 req-a312c1c4-62c2-4e06-addd-db89fae3348c service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-56aa20c6-f17d-43cf-b77f-0b1e350a4352 req-a312c1c4-62c2-4e06-addd-db89fae3348c service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-56aa20c6-f17d-43cf-b77f-0b1e350a4352 req-a312c1c4-62c2-4e06-addd-db89fae3348c service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:47:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-56aa20c6-f17d-43cf-b77f-0b1e350a4352 req-a312c1c4-62c2-4e06-addd-db89fae3348c service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-unplugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:47:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Instance destroyed successfully.
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.objects.instance [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lazy-loading 'resources' on Instance uuid fb5ccac9-1e45-4726-b681-cf34cf3fa521 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:30:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2041850193',display_name='tempest-ServerRescueNegativeTestJSON-server-2041850193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2041850193',id=2,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8acda82ef3f428fbb93847922a213d1',ramdisk_id='',reservation_id='r-44a0z2kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-241559119',owner_user_name='tempest-ServerRescueNegativeTestJSON-241559119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:36:54Z,user_data=None,user_id='d059c8dff3644f3c9c0c54498a4d78f7',uuid=fb5ccac9-1e45-4726-b681-cf34cf3fa521,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converting VIF {"id": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "address": "fa:16:3e:57:cb:7b", "network": {"id": "de376ae8-a0af-4eda-95e8-dfb1ca0f2283", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1261629972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8acda82ef3f428fbb93847922a213d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47b104-c8", "ovs_interfaceid": "fd47b104-c8ff-4b76-8f3a-53725f9f318c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=fd47b104-c8ff-4b76-8f3a-53725f9f318c,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47b104-c8') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG os_vif [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=fd47b104-c8ff-4b76-8f3a-53725f9f318c,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47b104-c8') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd47b104-c8, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:47:23 user nova-compute[70374]: INFO os_vif [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=fd47b104-c8ff-4b76-8f3a-53725f9f318c,network=Network(de376ae8-a0af-4eda-95e8-dfb1ca0f2283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47b104-c8')
Jul 27 09:47:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Deleting instance files /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521_del
Jul 27 09:47:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Deletion of /opt/stack/data/nova/instances/fb5ccac9-1e45-4726-b681-cf34cf3fa521_del complete
Jul 27 09:47:23 user nova-compute[70374]: INFO nova.compute.manager [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 27 09:47:23 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:47:23 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Took 0.55 seconds to deallocate network for instance.
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-23b3491a-5f5d-4e3a-a00d-c34df2c4710e req-f5ba5ddd-5eea-4026-994d-c366b7a39418 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-deleted-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:23 user nova-compute[70374]: INFO nova.compute.manager [req-23b3491a-5f5d-4e3a-a00d-c34df2c4710e req-f5ba5ddd-5eea-4026-994d-c366b7a39418 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Neutron deleted interface fd47b104-c8ff-4b76-8f3a-53725f9f318c; detaching it from the instance and deleting it from the info cache
Jul 27 09:47:23 user nova-compute[70374]: DEBUG nova.network.neutron [req-23b3491a-5f5d-4e3a-a00d-c34df2c4710e req-f5ba5ddd-5eea-4026-994d-c366b7a39418 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-23b3491a-5f5d-4e3a-a00d-c34df2c4710e req-f5ba5ddd-5eea-4026-994d-c366b7a39418 service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Detach interface failed, port_id=fd47b104-c8ff-4b76-8f3a-53725f9f318c, reason: Instance fb5ccac9-1e45-4726-b681-cf34cf3fa521 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:24 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Deleted allocations for instance fb5ccac9-1e45-4726-b681-cf34cf3fa521
Jul 27 09:47:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-6909bfa6-0bf0-4824-9f0a-e544034bdf8c tempest-ServerRescueNegativeTestJSON-241559119 tempest-ServerRescueNegativeTestJSON-241559119-project-member] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-9074b10a-1958-4258-99c8-c410c2160809 req-77bcb08a-84ea-439f-8211-497bb69747de service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9074b10a-1958-4258-99c8-c410c2160809 req-77bcb08a-84ea-439f-8211-497bb69747de service nova] Acquiring lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9074b10a-1958-4258-99c8-c410c2160809 req-77bcb08a-84ea-439f-8211-497bb69747de service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9074b10a-1958-4258-99c8-c410c2160809 req-77bcb08a-84ea-439f-8211-497bb69747de service nova] Lock "fb5ccac9-1e45-4726-b681-cf34cf3fa521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:24 user nova-compute[70374]: DEBUG nova.compute.manager [req-9074b10a-1958-4258-99c8-c410c2160809 req-77bcb08a-84ea-439f-8211-497bb69747de service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] No waiting events found dispatching network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:47:24 user nova-compute[70374]: WARNING nova.compute.manager [req-9074b10a-1958-4258-99c8-c410c2160809 req-77bcb08a-84ea-439f-8211-497bb69747de service nova] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Received unexpected event network-vif-plugged-fd47b104-c8ff-4b76-8f3a-53725f9f318c for instance with vm_state deleted and task_state None.
Jul 27 09:47:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "fe923721-b4e2-4735-823f-dae34d703018" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "fe923721-b4e2-4735-823f-dae34d703018" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "fe923721-b4e2-4735-823f-dae34d703018-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:27 user nova-compute[70374]: INFO nova.compute.manager [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Terminating instance
Jul 27 09:47:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-863b2938-e196-4fc5-9122-ec26f3f843e0 req-786a0861-3ecc-4cbb-8e5d-5bca581d5f09 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received event network-vif-unplugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-863b2938-e196-4fc5-9122-ec26f3f843e0 req-786a0861-3ecc-4cbb-8e5d-5bca581d5f09 service nova] Acquiring lock "fe923721-b4e2-4735-823f-dae34d703018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-863b2938-e196-4fc5-9122-ec26f3f843e0 req-786a0861-3ecc-4cbb-8e5d-5bca581d5f09 service nova] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-863b2938-e196-4fc5-9122-ec26f3f843e0 req-786a0861-3ecc-4cbb-8e5d-5bca581d5f09 service nova] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-863b2938-e196-4fc5-9122-ec26f3f843e0 req-786a0861-3ecc-4cbb-8e5d-5bca581d5f09 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] No waiting events found dispatching network-vif-unplugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-863b2938-e196-4fc5-9122-ec26f3f843e0 req-786a0861-3ecc-4cbb-8e5d-5bca581d5f09 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received event network-vif-unplugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:47:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: fe923721-b4e2-4735-823f-dae34d703018] Instance destroyed successfully.
Jul 27 09:47:27 user nova-compute[70374]: DEBUG nova.objects.instance [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lazy-loading 'resources' on Instance uuid fe923721-b4e2-4735-823f-dae34d703018 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-653845909',display_name='tempest-VolumesNegativeTest-instance-653845909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-653845909',id=33,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:45:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc977727b20a4c11b1ec74819dc479d2',ramdisk_id='',reservation_id='r-4ypdx7mh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1633535875',owner_user_name='tempest-VolumesNegativeTest-1633535875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:45:45Z,user_data=None,user_id='8a1c91b06b624fa399c78ff15179865d',uuid=fe923721-b4e2-4735-823f-dae34d703018,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Converting VIF {"id": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "address": "fa:16:3e:f0:68:ae", "network": {"id": "267c45e5-9823-49cc-bb4e-150e04e511d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "37aff788807d4b2aafc10d355583f7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a8fa314-03", "ovs_interfaceid": "0a8fa314-033f-4fd4-b6b9-eae84b9e59e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=0a8fa314-033f-4fd4-b6b9-eae84b9e59e1,network=Network(267c45e5-9823-49cc-bb4e-150e04e511d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8fa314-03') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG os_vif [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=0a8fa314-033f-4fd4-b6b9-eae84b9e59e1,network=Network(267c45e5-9823-49cc-bb4e-150e04e511d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8fa314-03') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a8fa314-03, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:47:27 user nova-compute[70374]: INFO os_vif [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=0a8fa314-033f-4fd4-b6b9-eae84b9e59e1,network=Network(267c45e5-9823-49cc-bb4e-150e04e511d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a8fa314-03')
Jul 27 09:47:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Deleting instance files /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018_del
Jul 27 09:47:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Deletion of /opt/stack/data/nova/instances/fe923721-b4e2-4735-823f-dae34d703018_del complete
Jul 27 09:47:28 user nova-compute[70374]: INFO nova.compute.manager [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] [instance: fe923721-b4e2-4735-823f-dae34d703018] Took 0.83 seconds to destroy the instance on the hypervisor.
Jul 27 09:47:28 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: fe923721-b4e2-4735-823f-dae34d703018] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: fe923721-b4e2-4735-823f-dae34d703018] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: fe923721-b4e2-4735-823f-dae34d703018] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf7655bd-39c8-429c-be0a-592cc27e392c req-fb017797-c136-42f8-a0c0-a9590ddf0aba service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received event network-vif-deleted-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:28 user nova-compute[70374]: INFO nova.compute.manager [req-bf7655bd-39c8-429c-be0a-592cc27e392c req-fb017797-c136-42f8-a0c0-a9590ddf0aba service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Neutron deleted interface 0a8fa314-033f-4fd4-b6b9-eae84b9e59e1; detaching it from the instance and deleting it from the info cache
Jul 27 09:47:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-bf7655bd-39c8-429c-be0a-592cc27e392c req-fb017797-c136-42f8-a0c0-a9590ddf0aba service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:47:28 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: fe923721-b4e2-4735-823f-dae34d703018] Took 0.47 seconds to deallocate network for instance.
Jul 27 09:47:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf7655bd-39c8-429c-be0a-592cc27e392c req-fb017797-c136-42f8-a0c0-a9590ddf0aba service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Detach interface failed, port_id=0a8fa314-033f-4fd4-b6b9-eae84b9e59e1, reason: Instance fe923721-b4e2-4735-823f-dae34d703018 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:47:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:28 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Deleted allocations for instance fe923721-b4e2-4735-823f-dae34d703018
Jul 27 09:47:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-743a0975-bf1b-4c4b-8d1b-f1030b4e0012 tempest-VolumesNegativeTest-1633535875 tempest-VolumesNegativeTest-1633535875-project-member] Lock "fe923721-b4e2-4735-823f-dae34d703018" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.712s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-ad3f060d-fa47-4054-9e68-350d9c364dea req-aaed14c4-9b7c-4d44-9d42-46492676c565 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received event network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad3f060d-fa47-4054-9e68-350d9c364dea req-aaed14c4-9b7c-4d44-9d42-46492676c565 service nova] Acquiring lock "fe923721-b4e2-4735-823f-dae34d703018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad3f060d-fa47-4054-9e68-350d9c364dea req-aaed14c4-9b7c-4d44-9d42-46492676c565 service nova] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ad3f060d-fa47-4054-9e68-350d9c364dea req-aaed14c4-9b7c-4d44-9d42-46492676c565 service nova] Lock "fe923721-b4e2-4735-823f-dae34d703018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-ad3f060d-fa47-4054-9e68-350d9c364dea req-aaed14c4-9b7c-4d44-9d42-46492676c565 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] No waiting events found dispatching network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:47:29 user nova-compute[70374]: WARNING nova.compute.manager [req-ad3f060d-fa47-4054-9e68-350d9c364dea req-aaed14c4-9b7c-4d44-9d42-46492676c565 service nova] [instance: fe923721-b4e2-4735-823f-dae34d703018] Received unexpected event network-vif-plugged-0a8fa314-033f-4fd4-b6b9-eae84b9e59e1 for instance with vm_state deleted and task_state None.
Jul 27 09:47:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:47:38 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451243.308021, fb5ccac9-1e45-4726-b681-cf34cf3fa521 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:47:38 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] VM Stopped (Lifecycle Event)
Jul 27 09:47:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-99e5518f-e121-4eea-b218-ccecd6861b79 None None] [instance: fb5ccac9-1e45-4726-b681-cf34cf3fa521] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:47:42 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451247.9513638, fe923721-b4e2-4735-823f-dae34d703018 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:47:42 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: fe923721-b4e2-4735-823f-dae34d703018] VM Stopped (Lifecycle Event)
Jul 27 09:47:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f1b2b769-db2b-4c3e-8344-b347135bd6dc None None] [instance: fe923721-b4e2-4735-823f-dae34d703018] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:47:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:47 user nova-compute[70374]: INFO nova.compute.manager [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Terminating instance
Jul 27 09:47:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-a7bc12f9-282e-4c56-a49b-6a14842ca8f3 req-24216ad3-8cb1-4cef-a8d8-db93e38fa7f3 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-unplugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a7bc12f9-282e-4c56-a49b-6a14842ca8f3 req-24216ad3-8cb1-4cef-a8d8-db93e38fa7f3 service nova] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a7bc12f9-282e-4c56-a49b-6a14842ca8f3 req-24216ad3-8cb1-4cef-a8d8-db93e38fa7f3 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a7bc12f9-282e-4c56-a49b-6a14842ca8f3 req-24216ad3-8cb1-4cef-a8d8-db93e38fa7f3 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-a7bc12f9-282e-4c56-a49b-6a14842ca8f3 req-24216ad3-8cb1-4cef-a8d8-db93e38fa7f3 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] No waiting events found dispatching network-vif-unplugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-a7bc12f9-282e-4c56-a49b-6a14842ca8f3 req-24216ad3-8cb1-4cef-a8d8-db93e38fa7f3 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-unplugged-dfa2198f-6276-43cd-8b58-8281d4424143 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:47:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Instance destroyed successfully.
Jul 27 09:47:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'resources' on Instance uuid 56ab07d0-823d-4282-bdc5-21910c33678a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038229673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1038229673',id=30,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOggog+sD4MFx0TWo+CfaL3x6gHI0VGarfQSfGQ3rWq08Yysx0zbtwW7ER+CAZlTK2NE1UVnxPc+lt5QyNYC4qOg/idV3sz+RgkLh8GySrbyoOyjcG2gias3K2Jazhaw+w==',key_name='tempest-keypair-1092477681',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-1ws0fl1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:45:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=56ab07d0-823d-4282-bdc5-21910c33678a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "dfa2198f-6276-43cd-8b58-8281d4424143", "address": "fa:16:3e:e9:1f:ee", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa2198f-62", "ovs_interfaceid": "dfa2198f-6276-43cd-8b58-8281d4424143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG os_vif [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfa2198f-62, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:47:48 user nova-compute[70374]: INFO os_vif [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=dfa2198f-6276-43cd-8b58-8281d4424143,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa2198f-62')
Jul 27 09:47:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Deleting instance files /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a_del
Jul 27 09:47:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Deletion of /opt/stack/data/nova/instances/56ab07d0-823d-4282-bdc5-21910c33678a_del complete
Jul 27 09:47:48 user nova-compute[70374]: INFO nova.compute.manager [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 27 09:47:48 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:47:48 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:47:49 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Took 1.31 seconds to deallocate network for instance.
Jul 27 09:47:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-f7627348-db79-40d1-ac67-4049bda2e3c3 req-797bfa66-ec6c-4020-a380-d4b5f38c4991 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f7627348-db79-40d1-ac67-4049bda2e3c3 req-797bfa66-ec6c-4020-a380-d4b5f38c4991 service nova] Acquiring lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f7627348-db79-40d1-ac67-4049bda2e3c3 req-797bfa66-ec6c-4020-a380-d4b5f38c4991 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f7627348-db79-40d1-ac67-4049bda2e3c3 req-797bfa66-ec6c-4020-a380-d4b5f38c4991 service nova] Lock "56ab07d0-823d-4282-bdc5-21910c33678a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-f7627348-db79-40d1-ac67-4049bda2e3c3 req-797bfa66-ec6c-4020-a380-d4b5f38c4991 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] No waiting events found dispatching network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:47:49 user nova-compute[70374]: WARNING nova.compute.manager [req-f7627348-db79-40d1-ac67-4049bda2e3c3 req-797bfa66-ec6c-4020-a380-d4b5f38c4991 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received unexpected event network-vif-plugged-dfa2198f-6276-43cd-8b58-8281d4424143 for instance with vm_state deleted and task_state None.
Jul 27 09:47:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-f7627348-db79-40d1-ac67-4049bda2e3c3 req-797bfa66-ec6c-4020-a380-d4b5f38c4991 service nova] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Received event network-vif-deleted-dfa2198f-6276-43cd-8b58-8281d4424143 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:47:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:49 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Deleted allocations for instance 56ab07d0-823d-4282-bdc5-21910c33678a
Jul 27 09:47:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-046d7f45-3a54-44bd-8edc-771f2b2233e8 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "56ab07d0-823d-4282-bdc5-21910c33678a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.557s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Port ad798508-8253-45fd-874b-abfa6dc1b966 binding to destination host user is already ACTIVE {{(pid=70374) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Creating tmpfile /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/tmpbv2ydona to verify with other compute node that the instance is on the same shared storage. {{(pid=70374) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-f414dc72-e081-4ebb-83c2-beb4150cff4d req-d1603ae4-d6f4-45be-a8e5-4a71b3902f04 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f414dc72-e081-4ebb-83c2-beb4150cff4d req-d1603ae4-d6f4-45be-a8e5-4a71b3902f04 service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f414dc72-e081-4ebb-83c2-beb4150cff4d req-d1603ae4-d6f4-45be-a8e5-4a71b3902f04 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f414dc72-e081-4ebb-83c2-beb4150cff4d req-d1603ae4-d6f4-45be-a8e5-4a71b3902f04 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:56 user nova-compute[70374]: DEBUG nova.compute.manager [req-f414dc72-e081-4ebb-83c2-beb4150cff4d req-d1603ae4-d6f4-45be-a8e5-4a71b3902f04 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:47:56 user nova-compute[70374]: WARNING nova.compute.manager [req-f414dc72-e081-4ebb-83c2-beb4150cff4d req-d1603ae4-d6f4-45be-a8e5-4a71b3902f04 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state resized and task_state resize_reverting.
Jul 27 09:47:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance destroyed successfully.
Jul 27 09:47:57 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'resources' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_vif [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad798508-82, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:47:57 user nova-compute[70374]: INFO os_vif [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82')
Jul 27 09:47:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:47:57 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd286065-23a6-43b0-a7e0-95be14403b56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:47:57 user nova-compute[70374]: No targets found.
Jul 27 09:47:57 user nova-compute[70374]: iSNS:
Jul 27 09:47:57 user nova-compute[70374]: No targets found.
Jul 27 09:47:57 user nova-compute[70374]: STATIC:
Jul 27 09:47:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401
Jul 27 09:47:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:47:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:47:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462
Jul 27 09:47:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:47:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:47:57 user nova-compute[70374]: FIRMWARE:
Jul 27 09:47:57 user nova-compute[70374]: No targets found.
Jul 27 09:47:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:47:57 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:47:57 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f670c9a-7981-4f7f-a899-4042d9e258f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6435be-c183-4dc4-9589-a0903fb8072c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:47:57 user nova-compute[70374]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:47:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:47:57 user nova-compute[70374]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:47:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc2236d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b55da1-5249-4d2f-bcdb-f274e77394b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9422b89f-ce63-4c03-8317-7fb240121b5c]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76373e8-2a2d-4c16-b2cc-0b0b98d39584]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1093c-58a0-4b28-8cab-044db9ccc972]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b261eb2-fabd-4fa8-81e8-ca37d6934a68]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d186a098-ffa6-4c11-9f52-f08e076d113c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]
Jul 27 09:47:57 user nova-compute[70374]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.
Jul 27 09:47:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d0626e-fecf-41ee-a74f-7a83b8cd0d67]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== disconnect_volume: return (282ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:47:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:47:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:58 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'migration_context' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:47:58 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:47:58 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:47:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.254s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-26ce2315-e504-4bee-b146-30b7df25852f req-ae0ab2ee-2824-4287-b129-4b5d981d4ea5 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-26ce2315-e504-4bee-b146-30b7df25852f req-ae0ab2ee-2824-4287-b129-4b5d981d4ea5 service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-26ce2315-e504-4bee-b146-30b7df25852f req-ae0ab2ee-2824-4287-b129-4b5d981d4ea5 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-26ce2315-e504-4bee-b146-30b7df25852f req-ae0ab2ee-2824-4287-b129-4b5d981d4ea5 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-26ce2315-e504-4bee-b146-30b7df25852f req-ae0ab2ee-2824-4287-b129-4b5d981d4ea5 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:47:59 user nova-compute[70374]: WARNING nova.compute.manager [req-26ce2315-e504-4bee-b146-30b7df25852f req-ae0ab2ee-2824-4287-b129-4b5d981d4ea5 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state resized and task_state resize_reverting.
Jul 27 09:47:59 user nova-compute[70374]: INFO nova.compute.manager [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Swapping old allocation on dict_keys(['f7548644-4a09-4ad8-9aa6-6e05d85a9f5b']) held by migration 449efb11-c37b-41f6-82c8-f91156492cfd for instance
Jul 27 09:47:59 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Overwriting current allocation {'allocations': {'f7548644-4a09-4ad8-9aa6-6e05d85a9f5b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 39}}, 'project_id': '6457496dd4d54638a58c4e731420e473', 'user_id': '906960beba9548c1b0bfb37011957bd7', 'consumer_generation': 1} on consumer bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG nova.network.neutron [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG os_brick.utils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9acbf42-7efd-403c-9b57-9a8f6f6ac9c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f805a9d-afbc-486b-af93-444ec4da74f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[952946fb-3657-4712-b641-e0474d186da7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcec35a9-4d34-42a6-abce-ba92182c6fc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:47:59 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:47:59 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[478a1ced-08d8-44dd-863d-1c6274cedeab]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:47:59 user nova-compute[70374]: DEBUG os_brick.utils [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:48:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:03 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451268.1623309, 56ab07d0-823d-4282-bdc5-21910c33678a => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:48:03 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] VM Stopped (Lifecycle Event)
Jul 27 09:48:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ad324365-268d-461e-9fe8-230ec367979a None None] [instance: 56ab07d0-823d-4282-bdc5-21910c33678a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Starting finish_revert_migration {{(pid=70374) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Start _get_guest_xml network_info=[{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '38d98e4e-c71b-4a8b-aea4-074ed05afd38', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee', 'attached_at': '2023-07-27T09:48:06.000000', 'detached_at': '', 'volume_id': 'c6bc10fe-eff6-493c-be2c-90b8af41d462', 'serial': 'c6bc10fe-eff6-493c-be2c-90b8af41d462'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:48:06 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:48:06 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'vcpu_model' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:48:06 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:48:06 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:48:06 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d434aff3-08d9-4eb8-9b4d-74ec55463f37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:48:06 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0f8bb0-5ea7-4a9c-b17c-911e76a7a970]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462] added
Jul 27 09:48:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8313d8cb-25eb-419e-8c10-dc8b84106189]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68392db-12c1-4ed3-a031-3e098e0c606c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWKERxAS {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWKERxAS" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f4d2a-e893-4e7a-b51d-e6b4d24055ff]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWKERxAS'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b4f334-a6c7-4f00-8a93-b908533eb213]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7393d837-ecd1-4a4c-afa6-46be7daeabe6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:48:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:48:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1b7168-5f85-4c2a-8b77-1b49373e793c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]
Jul 27 09:48:06 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.
Jul 27 09:48:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45d2031-bad2-41f2-8508-81b6ba0ea6b2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a672ae20-8ca1-428c-a3be-b01c486222bf]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:48:06 user nova-compute[70374]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:48:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:48:06 user nova-compute[70374]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:48:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d9a8a2-6653-4715-82d2-4abb991ea583]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:48:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26333666432306134', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333666432306134', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:47:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:48:07 user nova-compute[70374]:   <uuid>bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</uuid>
Jul 27 09:48:07 user nova-compute[70374]:   <name>instance-0000001f</name>
Jul 27 09:48:07 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:48:07 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:48:07 user nova-compute[70374]:   <metadata>
Jul 27 09:48:07 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:48:07 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:48:07 user nova-compute[70374]:       <nova:name>tempest-ServerActionsTestOtherB-server-320285733</nova:name>
Jul 27 09:48:07 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:48:06</nova:creationTime>
Jul 27 09:48:07 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:48:07 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:48:07 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:48:07 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:48:07 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:48:07 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:48:07 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:48:07 user nova-compute[70374]:       <nova:owner>
Jul 27 09:48:07 user nova-compute[70374]:         <nova:user uuid="906960beba9548c1b0bfb37011957bd7">tempest-ServerActionsTestOtherB-247493366-project-member</nova:user>
Jul 27 09:48:07 user nova-compute[70374]:         <nova:project uuid="6457496dd4d54638a58c4e731420e473">tempest-ServerActionsTestOtherB-247493366</nova:project>
Jul 27 09:48:07 user nova-compute[70374]:       </nova:owner>
Jul 27 09:48:07 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:48:07 user nova-compute[70374]:       <nova:ports>
Jul 27 09:48:07 user nova-compute[70374]:         <nova:port uuid="ad798508-8253-45fd-874b-abfa6dc1b966">
Jul 27 09:48:07 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 09:48:07 user nova-compute[70374]:         </nova:port>
Jul 27 09:48:07 user nova-compute[70374]:       </nova:ports>
Jul 27 09:48:07 user nova-compute[70374]:     </nova:instance>
Jul 27 09:48:07 user nova-compute[70374]:   </metadata>
Jul 27 09:48:07 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:48:07 user nova-compute[70374]:     <system>
Jul 27 09:48:07 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:48:07 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:48:07 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:48:07 user nova-compute[70374]:       <entry name="serial">bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</entry>
Jul 27 09:48:07 user nova-compute[70374]:       <entry name="uuid">bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee</entry>
Jul 27 09:48:07 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:48:07 user nova-compute[70374]:     </system>
Jul 27 09:48:07 user nova-compute[70374]:   </sysinfo>
Jul 27 09:48:07 user nova-compute[70374]:   <os>
Jul 27 09:48:07 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:48:07 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:48:07 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:48:07 user nova-compute[70374]:   </os>
Jul 27 09:48:07 user nova-compute[70374]:   <features>
Jul 27 09:48:07 user nova-compute[70374]:     <acpi/>
Jul 27 09:48:07 user nova-compute[70374]:     <apic/>
Jul 27 09:48:07 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:48:07 user nova-compute[70374]:   </features>
Jul 27 09:48:07 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:48:07 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:48:07 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:48:07 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:48:07 user nova-compute[70374]:   </clock>
Jul 27 09:48:07 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:48:07 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:48:07 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:48:07 user nova-compute[70374]:   </cpu>
Jul 27 09:48:07 user nova-compute[70374]:   <devices>
Jul 27 09:48:07 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:48:07 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:48:07 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk"/>
Jul 27 09:48:07 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:48:07 user nova-compute[70374]:     </disk>
Jul 27 09:48:07 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:48:07 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:48:07 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 09:48:07 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:48:07 user nova-compute[70374]:       <serial>c6bc10fe-eff6-493c-be2c-90b8af41d462</serial>
Jul 27 09:48:07 user nova-compute[70374]:     </disk>
Jul 27 09:48:07 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:48:07 user nova-compute[70374]:       <mac address="fa:16:3e:d1:c6:60"/>
Jul 27 09:48:07 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:48:07 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:48:07 user nova-compute[70374]:       <target dev="tapad798508-82"/>
Jul 27 09:48:07 user nova-compute[70374]:     </interface>
Jul 27 09:48:07 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:48:07 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/console.log" append="off"/>
Jul 27 09:48:07 user nova-compute[70374]:     </serial>
Jul 27 09:48:07 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:48:07 user nova-compute[70374]:     <video>
Jul 27 09:48:07 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:48:07 user nova-compute[70374]:     </video>
Jul 27 09:48:07 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:48:07 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:48:07 user nova-compute[70374]:     </rng>
Jul 27 09:48:07 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:48:07 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:48:07 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:48:07 user nova-compute[70374]:     </memballoon>
Jul 27 09:48:07 user nova-compute[70374]:   </devices>
Jul 27 09:48:07 user nova-compute[70374]: </domain>
Jul 27 09:48:07 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:47:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG os_vif [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad798508-82, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad798508-82, col_values=(('external_ids', {'iface-id': 'ad798508-8253-45fd-874b-abfa6dc1b966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:c6:60', 'vm-uuid': 'bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:48:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:07 user nova-compute[70374]: INFO os_vif [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82')
Jul 27 09:48:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-1ec8ac52-c681-4b5f-b428-4fea9ec1a49a req-d7988c96-a73a-46e8-8629-c5d712b8fbf7 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1ec8ac52-c681-4b5f-b428-4fea9ec1a49a req-d7988c96-a73a-46e8-8629-c5d712b8fbf7 service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1ec8ac52-c681-4b5f-b428-4fea9ec1a49a req-d7988c96-a73a-46e8-8629-c5d712b8fbf7 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1ec8ac52-c681-4b5f-b428-4fea9ec1a49a req-d7988c96-a73a-46e8-8629-c5d712b8fbf7 service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-1ec8ac52-c681-4b5f-b428-4fea9ec1a49a req-d7988c96-a73a-46e8-8629-c5d712b8fbf7 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:48:09 user nova-compute[70374]: WARNING nova.compute.manager [req-1ec8ac52-c681-4b5f-b428-4fea9ec1a49a req-d7988c96-a73a-46e8-8629-c5d712b8fbf7 service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state resized and task_state resize_reverting.
Jul 27 09:48:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451291.1160934, bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:48:11 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] VM Resumed (Lifecycle Event)
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:48:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance running successfully.
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] finish_revert_migration finished successfully. {{(pid=70374) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:48:11 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451291.1198225, bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:48:11 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] VM Started (Lifecycle Event)
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:48:11 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-a44e7c34-81db-4294-8cf0-2cf2ffd5ad21 req-fd4ecef9-3e5f-4762-b42a-9dbd26c8eceb service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a44e7c34-81db-4294-8cf0-2cf2ffd5ad21 req-fd4ecef9-3e5f-4762-b42a-9dbd26c8eceb service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a44e7c34-81db-4294-8cf0-2cf2ffd5ad21 req-fd4ecef9-3e5f-4762-b42a-9dbd26c8eceb service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a44e7c34-81db-4294-8cf0-2cf2ffd5ad21 req-fd4ecef9-3e5f-4762-b42a-9dbd26c8eceb service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-a44e7c34-81db-4294-8cf0-2cf2ffd5ad21 req-fd4ecef9-3e5f-4762-b42a-9dbd26c8eceb service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:48:11 user nova-compute[70374]: WARNING nova.compute.manager [req-a44e7c34-81db-4294-8cf0-2cf2ffd5ad21 req-fd4ecef9-3e5f-4762-b42a-9dbd26c8eceb service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state resized and task_state resize_reverting.
Jul 27 09:48:11 user nova-compute[70374]: INFO nova.compute.manager [None req-b3a05396-636f-4560-a136-ed6178285e4a tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance to original state: 'active'
Jul 27 09:48:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:16 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:48:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [{"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:48:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:48:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:22 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:48:22 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8417MB free_disk=25.510486602783203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 931b15c3-29a5-4b70-92d0-4c22fc1b9303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:48:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:23 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:23 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-2098e283-5996-4c6a-9361-2b46e1c2c6d5 req-8219a747-04b5-4b80-9b48-143c0218b9b5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-changed-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-2098e283-5996-4c6a-9361-2b46e1c2c6d5 req-8219a747-04b5-4b80-9b48-143c0218b9b5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Refreshing instance network info cache due to event network-changed-5e54f01f-0732-4e78-bcc1-f9e45af08a0a. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2098e283-5996-4c6a-9361-2b46e1c2c6d5 req-8219a747-04b5-4b80-9b48-143c0218b9b5 service nova] Acquiring lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2098e283-5996-4c6a-9361-2b46e1c2c6d5 req-8219a747-04b5-4b80-9b48-143c0218b9b5 service nova] Acquired lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-2098e283-5996-4c6a-9361-2b46e1c2c6d5 req-8219a747-04b5-4b80-9b48-143c0218b9b5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Refreshing network info cache for port 5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-2098e283-5996-4c6a-9361-2b46e1c2c6d5 req-8219a747-04b5-4b80-9b48-143c0218b9b5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updated VIF entry in instance network info cache for port 5e54f01f-0732-4e78-bcc1-f9e45af08a0a. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-2098e283-5996-4c6a-9361-2b46e1c2c6d5 req-8219a747-04b5-4b80-9b48-143c0218b9b5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:48:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2098e283-5996-4c6a-9361-2b46e1c2c6d5 req-8219a747-04b5-4b80-9b48-143c0218b9b5 service nova] Releasing lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:48:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Stashing vm_state: active {{(pid=70374) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'pci_requests' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:48:34 user nova-compute[70374]: INFO nova.compute.claims [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Claim successful on node user
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'resources' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'pci_devices' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:48:34 user nova-compute[70374]: INFO nova.compute.resource_tracker [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating resource usage from migration 1be24ef9-97a0-4214-a545-74c336e706d3
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-4bfdef91-904b-4cb4-8b01-2d6b3576b516 req-f769bc97-ae60-420c-88e5-881585b14d74 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-changed-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-4bfdef91-904b-4cb4-8b01-2d6b3576b516 req-f769bc97-ae60-420c-88e5-881585b14d74 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Refreshing instance network info cache due to event network-changed-8688b83f-7507-454f-8b59-2a3293ca896d. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4bfdef91-904b-4cb4-8b01-2d6b3576b516 req-f769bc97-ae60-420c-88e5-881585b14d74 service nova] Acquiring lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4bfdef91-904b-4cb4-8b01-2d6b3576b516 req-f769bc97-ae60-420c-88e5-881585b14d74 service nova] Acquired lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-4bfdef91-904b-4cb4-8b01-2d6b3576b516 req-f769bc97-ae60-420c-88e5-881585b14d74 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Refreshing network info cache for port 8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.368s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:34 user nova-compute[70374]: INFO nova.compute.manager [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Migrating
Jul 27 09:48:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-4bfdef91-904b-4cb4-8b01-2d6b3576b516 req-f769bc97-ae60-420c-88e5-881585b14d74 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updated VIF entry in instance network info cache for port 8688b83f-7507-454f-8b59-2a3293ca896d. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-4bfdef91-904b-4cb4-8b01-2d6b3576b516 req-f769bc97-ae60-420c-88e5-881585b14d74 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4bfdef91-904b-4cb4-8b01-2d6b3576b516 req-f769bc97-ae60-420c-88e5-881585b14d74 service nova] Releasing lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquired lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:48:34 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:48:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:35 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:48:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Releasing lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:48:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Starting migrate_disk_and_power_off {{(pid=70374) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 09:48:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-unplugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] No waiting events found dispatching network-vif-unplugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:48:36 user nova-compute[70374]: WARNING nova.compute.manager [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received unexpected event network-vif-unplugged-8688b83f-7507-454f-8b59-2a3293ca896d for instance with vm_state active and task_state resize_migrating.
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] No waiting events found dispatching network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:48:36 user nova-compute[70374]: WARNING nova.compute.manager [req-7b27e188-075a-46b1-b6a7-aaf9a50757d5 req-b6c2d913-c260-46d9-98f4-7f17aa075bc3 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received unexpected event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d for instance with vm_state active and task_state resize_migrating.
Jul 27 09:48:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance destroyed successfully.
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1415728061',display_name='tempest-ServerActionsTestOtherA-server-1415728061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1415728061',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-ym8no9e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=931b15c3-29a5-4b70-92d0-4c22fc1b9303,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1385823171-network", "vif_mac": "fa:16:3e:5c:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1385823171-network", "vif_mac": "fa:16:3e:5c:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_vif [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8688b83f-75, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:48:36 user nova-compute[70374]: INFO os_vif [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75')
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXFjoRIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:48:36 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[610cc1b2-299e-4751-b389-47cc2c3674a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:48:36 user nova-compute[70374]: No targets found.
Jul 27 09:48:36 user nova-compute[70374]: iSNS:
Jul 27 09:48:36 user nova-compute[70374]: No targets found.
Jul 27 09:48:36 user nova-compute[70374]: STATIC:
Jul 27 09:48:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401
Jul 27 09:48:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:48:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:48:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462
Jul 27 09:48:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:48:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:48:36 user nova-compute[70374]: FIRMWARE:
Jul 27 09:48:36 user nova-compute[70374]: No targets found.
Jul 27 09:48:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:48:36 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:48:36 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[64018b73-a918-42e9-944b-0def2a5cfd3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f7ca1-3512-4569-81d2-a2882f043b8b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:48:36 user nova-compute[70374]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:48:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:48:36 user nova-compute[70374]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:48:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280b83b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0204946-140f-4a37-979a-38589c31a8c8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb0153d-1222-4403-9933-9efca014de34]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21f5c69-5c83-4c86-921a-129c9fff5b58]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bae0f3-77e8-492b-9d9a-8d11fb790f34]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23939316332346330', '/dev/disk/by-id/scsi-1SCST_BIOf817ade4-991c24c05954d8f9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f817ade4') {{(pid=82164) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82439b6-ca66-4e7c-ad71-4dd770a00775]: (4, None) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0330b20e-40a6-4b88-b1a5-b4a92e578b80]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1afc987-2178-418d-81e0-686c66fffec7]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260]
Jul 27 09:48:36 user nova-compute[70374]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260] successful.
Jul 27 09:48:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ecceb7-e2ca-4511-83dc-d2842756ff1d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== disconnect_volume: return (334ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:48:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:48:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Port 8688b83f-7507-454f-8b59-2a3293ca896d binding to destination host user is already ACTIVE {{(pid=70374) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 09:48:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:48:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquired lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:48:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Releasing lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG os_brick.utils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd130c5-1015-4cae-97a2-bd5f30e76603]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d271a5c2-b5dc-41dc-ae86-4cbc03d050f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a6d835-47be-4a25-a4c8-2df38efda8f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ddca92-efed-48cc-87de-a1fa17726add]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:48:39 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:48:39 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dba9dd-3821-4439-9306-0cb0b5441100]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:48:39 user nova-compute[70374]: DEBUG os_brick.utils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:48:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:48:42 user nova-compute[70374]: INFO nova.compute.claims [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Claim successful on node user
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:48:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:48:42 user nova-compute[70374]: DEBUG nova.policy [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '377915ad2c6e4244b5bd1a7ed97c6afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d32e43d96bc4f0a99fd3378c1677fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:48:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Creating image(s)
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk 1073741824" returned: 0 in 0.049s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.169s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:43 user nova-compute[70374]: DEBUG nova.network.neutron [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Successfully created port: bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Cannot resize image /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'migration_context' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Ensure instance console log exists: /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.network.neutron [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Successfully updated port: bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquired lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.network.neutron [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-39187911-ef45-429c-b63e-bcde04f6dc95 req-e40985b2-936d-4ce9-a88e-aa66a631ccb2 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-changed-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-39187911-ef45-429c-b63e-bcde04f6dc95 req-e40985b2-936d-4ce9-a88e-aa66a631ccb2 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Refreshing instance network info cache due to event network-changed-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39187911-ef45-429c-b63e-bcde04f6dc95 req-e40985b2-936d-4ce9-a88e-aa66a631ccb2 service nova] Acquiring lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:48:44 user nova-compute[70374]: DEBUG nova.network.neutron [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating instance_info_cache with network_info: [{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Releasing lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance network_info: |[{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39187911-ef45-429c-b63e-bcde04f6dc95 req-e40985b2-936d-4ce9-a88e-aa66a631ccb2 service nova] Acquired lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-39187911-ef45-429c-b63e-bcde04f6dc95 req-e40985b2-936d-4ce9-a88e-aa66a631ccb2 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Refreshing network info cache for port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Start _get_guest_xml network_info=[{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:48:45 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:48:45 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-224474522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-224474522',id=35,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuV0qR/Ed0QIyRTfenNYTPSi1Xqznmf0lvxujvI1zqxuAvV4Lc0TIHQ/hKJ78U0OyU4woeLxnFhFf7LAGGX+doBW5PBY0NGNgTMGCx3E/qhixWZxAY4sc74cz3302cKoA==',key_name='tempest-keypair-1842228732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-4dravgqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:48:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=4ece765d-2273-40d7-bb46-39d87fd0c819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.objects.instance [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:48:45 user nova-compute[70374]:   <uuid>4ece765d-2273-40d7-bb46-39d87fd0c819</uuid>
Jul 27 09:48:45 user nova-compute[70374]:   <name>instance-00000023</name>
Jul 27 09:48:45 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:48:45 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:48:45 user nova-compute[70374]:   <metadata>
Jul 27 09:48:45 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:48:45 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:48:45 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-224474522</nova:name>
Jul 27 09:48:45 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:48:45</nova:creationTime>
Jul 27 09:48:45 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:48:45 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:48:45 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:48:45 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:48:45 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:48:45 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:48:45 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:48:45 user nova-compute[70374]:       <nova:owner>
Jul 27 09:48:45 user nova-compute[70374]:         <nova:user uuid="377915ad2c6e4244b5bd1a7ed97c6afb">tempest-AttachVolumeShelveTestJSON-1605888290-project-member</nova:user>
Jul 27 09:48:45 user nova-compute[70374]:         <nova:project uuid="5d32e43d96bc4f0a99fd3378c1677fb7">tempest-AttachVolumeShelveTestJSON-1605888290</nova:project>
Jul 27 09:48:45 user nova-compute[70374]:       </nova:owner>
Jul 27 09:48:45 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:48:45 user nova-compute[70374]:       <nova:ports>
Jul 27 09:48:45 user nova-compute[70374]:         <nova:port uuid="bef25bb2-a169-4d36-b13f-ac8fd72b5d2c">
Jul 27 09:48:45 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:48:45 user nova-compute[70374]:         </nova:port>
Jul 27 09:48:45 user nova-compute[70374]:       </nova:ports>
Jul 27 09:48:45 user nova-compute[70374]:     </nova:instance>
Jul 27 09:48:45 user nova-compute[70374]:   </metadata>
Jul 27 09:48:45 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:48:45 user nova-compute[70374]:     <system>
Jul 27 09:48:45 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:48:45 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:48:45 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:48:45 user nova-compute[70374]:       <entry name="serial">4ece765d-2273-40d7-bb46-39d87fd0c819</entry>
Jul 27 09:48:45 user nova-compute[70374]:       <entry name="uuid">4ece765d-2273-40d7-bb46-39d87fd0c819</entry>
Jul 27 09:48:45 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:48:45 user nova-compute[70374]:     </system>
Jul 27 09:48:45 user nova-compute[70374]:   </sysinfo>
Jul 27 09:48:45 user nova-compute[70374]:   <os>
Jul 27 09:48:45 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:48:45 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:48:45 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:48:45 user nova-compute[70374]:   </os>
Jul 27 09:48:45 user nova-compute[70374]:   <features>
Jul 27 09:48:45 user nova-compute[70374]:     <acpi/>
Jul 27 09:48:45 user nova-compute[70374]:     <apic/>
Jul 27 09:48:45 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:48:45 user nova-compute[70374]:   </features>
Jul 27 09:48:45 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:48:45 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:48:45 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:48:45 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:48:45 user nova-compute[70374]:   </clock>
Jul 27 09:48:45 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:48:45 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:48:45 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:48:45 user nova-compute[70374]:   </cpu>
Jul 27 09:48:45 user nova-compute[70374]:   <devices>
Jul 27 09:48:45 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:48:45 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:48:45 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk"/>
Jul 27 09:48:45 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:48:45 user nova-compute[70374]:     </disk>
Jul 27 09:48:45 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:48:45 user nova-compute[70374]:       <mac address="fa:16:3e:95:c9:e3"/>
Jul 27 09:48:45 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:48:45 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:48:45 user nova-compute[70374]:       <target dev="tapbef25bb2-a1"/>
Jul 27 09:48:45 user nova-compute[70374]:     </interface>
Jul 27 09:48:45 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:48:45 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/console.log" append="off"/>
Jul 27 09:48:45 user nova-compute[70374]:     </serial>
Jul 27 09:48:45 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:48:45 user nova-compute[70374]:     <video>
Jul 27 09:48:45 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:48:45 user nova-compute[70374]:     </video>
Jul 27 09:48:45 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:48:45 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:48:45 user nova-compute[70374]:     </rng>
Jul 27 09:48:45 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:48:45 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:48:45 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:48:45 user nova-compute[70374]:     </memballoon>
Jul 27 09:48:45 user nova-compute[70374]:   </devices>
Jul 27 09:48:45 user nova-compute[70374]: </domain>
Jul 27 09:48:45 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-224474522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-224474522',id=35,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuV0qR/Ed0QIyRTfenNYTPSi1Xqznmf0lvxujvI1zqxuAvV4Lc0TIHQ/hKJ78U0OyU4woeLxnFhFf7LAGGX+doBW5PBY0NGNgTMGCx3E/qhixWZxAY4sc74cz3302cKoA==',key_name='tempest-keypair-1842228732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-4dravgqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:48:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=4ece765d-2273-40d7-bb46-39d87fd0c819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG os_vif [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbef25bb2-a1, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbef25bb2-a1, col_values=(('external_ids', {'iface-id': 'bef25bb2-a169-4d36-b13f-ac8fd72b5d2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:c9:e3', 'vm-uuid': '4ece765d-2273-40d7-bb46-39d87fd0c819'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:45 user nova-compute[70374]: INFO os_vif [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1')
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No VIF found with MAC fa:16:3e:95:c9:e3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-39187911-ef45-429c-b63e-bcde04f6dc95 req-e40985b2-936d-4ce9-a88e-aa66a631ccb2 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updated VIF entry in instance network info cache for port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-39187911-ef45-429c-b63e-bcde04f6dc95 req-e40985b2-936d-4ce9-a88e-aa66a631ccb2 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating instance_info_cache with network_info: [{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:48:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39187911-ef45-429c-b63e-bcde04f6dc95 req-e40985b2-936d-4ce9-a88e-aa66a631ccb2 service nova] Releasing lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Starting finish_migration {{(pid=70374) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance directory exists: not creating {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 09:48:46 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Creating image(s)
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Ensure instance console log exists: /opt/stack/data/nova/instances/931b15c3-29a5-4b70-92d0-4c22fc1b9303/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Start _get_guest_xml network_info=[{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1385823171-network", "vif_mac": "fa:16:3e:5c:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '7e9fdaca-e876-4421-adba-b7fb98a8ec2f', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXFjoRIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '931b15c3-29a5-4b70-92d0-4c22fc1b9303', 'attached_at': '2023-07-27T09:48:46.000000', 'detached_at': '', 'volume_id': '07b4a7fb-6c06-4202-b289-a51813df1401', 'serial': '07b4a7fb-6c06-4202-b289-a51813df1401'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:48:46 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:48:46 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'vcpu_model' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXFjoRIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:48:46 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:48:46 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:48:46 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[24238402-6f6f-4713-afcd-94eb9f2dda69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:48:46 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[42066a93-23fa-4f05-b190-e4cbac0cc5f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401] added
Jul 27 09:48:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[66044863-40a8-4299-bc2a-6c7d2b262440]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c592952-448c-4320-be5c-bc16a127c95c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXFjoRIa {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXFjoRIa" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52de164-6e48-400b-8442-be324918285f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXFjoRIa'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac50e1fe-8e8c-440b-b98c-2bc497054433]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[56816725-f69e-43f8-8105-fca84fc26ab0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:48:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:48:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfdcd17-437d-4cf0-9bba-4c470fae6c8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260]
Jul 27 09:48:46 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260] successful.
Jul 27 09:48:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b16944-0b48-4310-a1a6-7027570ec073]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd755e9-262d-4c83-a9c0-1d9c0a1e8e45]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:48:46 user nova-compute[70374]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:48:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:48:46 user nova-compute[70374]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:48:46 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba9ac1f-3a46-4d36-87af-f860dcf5673d]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-347d5943-cd29-4a3c-ac8d-58f992b148ef req-a1286430-54a9-4d6d-8624-9b4acebd76ef service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-347d5943-cd29-4a3c-ac8d-58f992b148ef req-a1286430-54a9-4d6d-8624-9b4acebd76ef service nova] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-347d5943-cd29-4a3c-ac8d-58f992b148ef req-a1286430-54a9-4d6d-8624-9b4acebd76ef service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-347d5943-cd29-4a3c-ac8d-58f992b148ef req-a1286430-54a9-4d6d-8624-9b4acebd76ef service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-347d5943-cd29-4a3c-ac8d-58f992b148ef req-a1286430-54a9-4d6d-8624-9b4acebd76ef service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] No waiting events found dispatching network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:48:46 user nova-compute[70374]: WARNING nova.compute.manager [req-347d5943-cd29-4a3c-ac8d-58f992b148ef req-a1286430-54a9-4d6d-8624-9b4acebd76ef service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received unexpected event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c for instance with vm_state building and task_state spawning.
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXFjoRIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23939316332346330', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939316332346330', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1415728061',display_name='tempest-ServerActionsTestOtherA-server-1415728061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1415728061',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-ym8no9e5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=931b15c3-29a5-4b70-92d0-4c22fc1b9303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1385823171-network", "vif_mac": "fa:16:3e:5c:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1385823171-network", "vif_mac": "fa:16:3e:5c:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:48:47 user nova-compute[70374]:   <uuid>931b15c3-29a5-4b70-92d0-4c22fc1b9303</uuid>
Jul 27 09:48:47 user nova-compute[70374]:   <name>instance-00000022</name>
Jul 27 09:48:47 user nova-compute[70374]:   <memory>2097152</memory>
Jul 27 09:48:47 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:48:47 user nova-compute[70374]:   <metadata>
Jul 27 09:48:47 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:48:47 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:48:47 user nova-compute[70374]:       <nova:name>tempest-ServerActionsTestOtherA-server-1415728061</nova:name>
Jul 27 09:48:47 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:48:46</nova:creationTime>
Jul 27 09:48:47 user nova-compute[70374]:       <nova:flavor name="m1.small">
Jul 27 09:48:47 user nova-compute[70374]:         <nova:memory>2048</nova:memory>
Jul 27 09:48:47 user nova-compute[70374]:         <nova:disk>20</nova:disk>
Jul 27 09:48:47 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:48:47 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:48:47 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:48:47 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:48:47 user nova-compute[70374]:       <nova:owner>
Jul 27 09:48:47 user nova-compute[70374]:         <nova:user uuid="a2b416973f744369818b2a67bcecdeb9">tempest-ServerActionsTestOtherA-2053926798-project-member</nova:user>
Jul 27 09:48:47 user nova-compute[70374]:         <nova:project uuid="f06bd4d4e7144fbc99c907fb405b7e99">tempest-ServerActionsTestOtherA-2053926798</nova:project>
Jul 27 09:48:47 user nova-compute[70374]:       </nova:owner>
Jul 27 09:48:47 user nova-compute[70374]:       <nova:ports>
Jul 27 09:48:47 user nova-compute[70374]:         <nova:port uuid="8688b83f-7507-454f-8b59-2a3293ca896d">
Jul 27 09:48:47 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 09:48:47 user nova-compute[70374]:         </nova:port>
Jul 27 09:48:47 user nova-compute[70374]:       </nova:ports>
Jul 27 09:48:47 user nova-compute[70374]:     </nova:instance>
Jul 27 09:48:47 user nova-compute[70374]:   </metadata>
Jul 27 09:48:47 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:48:47 user nova-compute[70374]:     <system>
Jul 27 09:48:47 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:48:47 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:48:47 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:48:47 user nova-compute[70374]:       <entry name="serial">931b15c3-29a5-4b70-92d0-4c22fc1b9303</entry>
Jul 27 09:48:47 user nova-compute[70374]:       <entry name="uuid">931b15c3-29a5-4b70-92d0-4c22fc1b9303</entry>
Jul 27 09:48:47 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:48:47 user nova-compute[70374]:     </system>
Jul 27 09:48:47 user nova-compute[70374]:   </sysinfo>
Jul 27 09:48:47 user nova-compute[70374]:   <os>
Jul 27 09:48:47 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:48:47 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:48:47 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:48:47 user nova-compute[70374]:   </os>
Jul 27 09:48:47 user nova-compute[70374]:   <features>
Jul 27 09:48:47 user nova-compute[70374]:     <acpi/>
Jul 27 09:48:47 user nova-compute[70374]:     <apic/>
Jul 27 09:48:47 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:48:47 user nova-compute[70374]:   </features>
Jul 27 09:48:47 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:48:47 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:48:47 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:48:47 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:48:47 user nova-compute[70374]:   </clock>
Jul 27 09:48:47 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:48:47 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:48:47 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:48:47 user nova-compute[70374]:   </cpu>
Jul 27 09:48:47 user nova-compute[70374]:   <devices>
Jul 27 09:48:47 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:48:47 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:48:47 user nova-compute[70374]:       <source dev="/dev/sdc"/>
Jul 27 09:48:47 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:48:47 user nova-compute[70374]:       <serial>07b4a7fb-6c06-4202-b289-a51813df1401</serial>
Jul 27 09:48:47 user nova-compute[70374]:     </disk>
Jul 27 09:48:47 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:48:47 user nova-compute[70374]:       <mac address="fa:16:3e:5c:df:ee"/>
Jul 27 09:48:47 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:48:47 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:48:47 user nova-compute[70374]:       <target dev="tap8688b83f-75"/>
Jul 27 09:48:47 user nova-compute[70374]:     </interface>
Jul 27 09:48:47 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:48:47 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/931b15c3-29a5-4b70-92d0-4c22fc1b9303/console.log" append="off"/>
Jul 27 09:48:47 user nova-compute[70374]:     </serial>
Jul 27 09:48:47 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:48:47 user nova-compute[70374]:     <video>
Jul 27 09:48:47 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:48:47 user nova-compute[70374]:     </video>
Jul 27 09:48:47 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:48:47 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:48:47 user nova-compute[70374]:     </rng>
Jul 27 09:48:47 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:48:47 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:48:47 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:48:47 user nova-compute[70374]:     </memballoon>
Jul 27 09:48:47 user nova-compute[70374]:   </devices>
Jul 27 09:48:47 user nova-compute[70374]: </domain>
Jul 27 09:48:47 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1415728061',display_name='tempest-ServerActionsTestOtherA-server-1415728061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1415728061',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-ym8no9e5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=931b15c3-29a5-4b70-92d0-4c22fc1b9303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1385823171-network", "vif_mac": "fa:16:3e:5c:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1385823171-network", "vif_mac": "fa:16:3e:5c:df:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG os_vif [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8688b83f-75, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8688b83f-75, col_values=(('external_ids', {'iface-id': '8688b83f-7507-454f-8b59-2a3293ca896d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:df:ee', 'vm-uuid': '931b15c3-29a5-4b70-92d0-4c22fc1b9303'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:47 user nova-compute[70374]: INFO os_vif [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75')
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:48:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] No VIF found with MAC fa:16:3e:5c:df:ee, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:48:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:48:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:48:48 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451328.9550827, 4ece765d-2273-40d7-bb46-39d87fd0c819 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:48:48 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] VM Resumed (Lifecycle Event)
Jul 27 09:48:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance spawned successfully.
Jul 27 09:48:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:48:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:48:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:48:49 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451328.9560537, 4ece765d-2273-40d7-bb46-39d87fd0c819 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:48:49 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] VM Started (Lifecycle Event)
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-69bd9ab8-5995-4e33-9076-c5309977fde6 req-b4cee4d3-ca05-4d03-b2dc-c43220fc9c9e service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69bd9ab8-5995-4e33-9076-c5309977fde6 req-b4cee4d3-ca05-4d03-b2dc-c43220fc9c9e service nova] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69bd9ab8-5995-4e33-9076-c5309977fde6 req-b4cee4d3-ca05-4d03-b2dc-c43220fc9c9e service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-69bd9ab8-5995-4e33-9076-c5309977fde6 req-b4cee4d3-ca05-4d03-b2dc-c43220fc9c9e service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-69bd9ab8-5995-4e33-9076-c5309977fde6 req-b4cee4d3-ca05-4d03-b2dc-c43220fc9c9e service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] No waiting events found dispatching network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:48:49 user nova-compute[70374]: WARNING nova.compute.manager [req-69bd9ab8-5995-4e33-9076-c5309977fde6 req-b4cee4d3-ca05-4d03-b2dc-c43220fc9c9e service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received unexpected event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c for instance with vm_state building and task_state spawning.
Jul 27 09:48:49 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:48:49 user nova-compute[70374]: INFO nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Took 5.81 seconds to spawn the instance on the hypervisor.
Jul 27 09:48:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:48:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:49 user nova-compute[70374]: INFO nova.compute.manager [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Took 6.84 seconds to build instance.
Jul 27 09:48:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edaaa871-01f4-4783-9f12-37e9b772db23 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.942s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] No waiting events found dispatching network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:48:51 user nova-compute[70374]: WARNING nova.compute.manager [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received unexpected event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d for instance with vm_state active and task_state resize_finish.
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] No waiting events found dispatching network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:48:51 user nova-compute[70374]: WARNING nova.compute.manager [req-aaf51730-cd81-4fb0-b8c8-c0a543544bf6 req-1a9f5b50-c4d9-46ff-9e6a-d620ef47517e service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received unexpected event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d for instance with vm_state active and task_state resize_finish.
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 931b15c3-29a5-4b70-92d0-4c22fc1b9303 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451331.2168632, 931b15c3-29a5-4b70-92d0-4c22fc1b9303 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:48:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] VM Resumed (Lifecycle Event)
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:48:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance running successfully.
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Failed to set time: agent not configured {{(pid=70374) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a26b863c-4469-4c8a-92fe-c57947b1078e tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] finish_migration finished successfully. {{(pid=70374) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 09:48:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451331.219548, 931b15c3-29a5-4b70-92d0-4c22fc1b9303 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:48:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] VM Started (Lifecycle Event)
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:48:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:48:51 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 09:48:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:48:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:49:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:17 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:49:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:49:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:49:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:24 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:49:24 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8296MB free_disk=25.46808624267578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Applying migration context for instance 931b15c3-29a5-4b70-92d0-4c22fc1b9303 as it has an incoming, in-progress migration 1be24ef9-97a0-4214-a545-74c336e706d3. Migration status is finished {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 09:49:24 user nova-compute[70374]: INFO nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating resource usage from migration 1be24ef9-97a0-4214-a545-74c336e706d3
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Migration 1be24ef9-97a0-4214-a545-74c336e706d3 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 931b15c3-29a5-4b70-92d0-4c22fc1b9303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 4ece765d-2273-40d7-bb46-39d87fd0c819 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:49:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:49:25 user nova-compute[70374]: INFO nova.compute.claims [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Claim successful on node user
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:49:25 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:49:25 user nova-compute[70374]: DEBUG nova.policy [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '229f3686d8184688b3ced860a5d7b07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51f550eb3b4bd8883b2242eb2905f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:49:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Creating image(s)
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "/opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "/opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "/opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "9ac7a738160b6ad9c217996c889f1574494fab00" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "9ac7a738160b6ad9c217996c889f1574494fab00" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00.part --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG nova.virt.images [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] 4bd68661-7500-4179-b5df-e32cecaf17a5 was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00.part /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Successfully created port: 71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00.part /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00.converted" returned: 0 in 0.286s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "9ac7a738160b6ad9c217996c889f1574494fab00" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.170s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "9ac7a738160b6ad9c217996c889f1574494fab00" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "9ac7a738160b6ad9c217996c889f1574494fab00" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00,backing_fmt=raw /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00,backing_fmt=raw /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk 1073741824" returned: 0 in 0.056s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "9ac7a738160b6ad9c217996c889f1574494fab00" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Successfully updated port: 71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-87e00d9d-72b3-4b7b-9c9b-afed2fc06a13 req-e1844051-8241-4077-a886-1d679e4c3d7e service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-changed-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-87e00d9d-72b3-4b7b-9c9b-afed2fc06a13 req-e1844051-8241-4077-a886-1d679e4c3d7e service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing instance network info cache due to event network-changed-71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87e00d9d-72b3-4b7b-9c9b-afed2fc06a13 req-e1844051-8241-4077-a886-1d679e4c3d7e service nova] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 --force-share --output=json" returned: 0 in 0.157s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Cannot resize image /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.objects.instance [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'migration_context' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Ensure instance console log exists: /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.network.neutron [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Instance network_info: |[{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87e00d9d-72b3-4b7b-9c9b-afed2fc06a13 req-e1844051-8241-4077-a886-1d679e4c3d7e service nova] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-87e00d9d-72b3-4b7b-9c9b-afed2fc06a13 req-e1844051-8241-4077-a886-1d679e4c3d7e service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing network info cache for port 71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Start _get_guest_xml network_info=[{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:49:22Z,direct_url=<?>,disk_format='qcow2',id=4bd68661-7500-4179-b5df-e32cecaf17a5,min_disk=0,min_ram=0,name='tempest-scenario-img--1793341642',owner='ec51f550eb3b4bd8883b2242eb2905f7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:49:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '4bd68661-7500-4179-b5df-e32cecaf17a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:49:28 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:49:28 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:49:22Z,direct_url=<?>,disk_format='qcow2',id=4bd68661-7500-4179-b5df-e32cecaf17a5,min_disk=0,min_ram=0,name='tempest-scenario-img--1793341642',owner='ec51f550eb3b4bd8883b2242eb2905f7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:49:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2042600824',display_name='tempest-TestMinimumBasicScenario-server-2042600824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2042600824',id=36,image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE1XN7Mz8irdJ5W8ZbQhTWChaYO4ff7cqi50Szx1yn/v3gWx2SJUQfHT4ZvHDw03qmc0t+d94JKmbOAcpHp88aF7kn3HcBC1m5pwTdaBhJDo8Y6s8TSSpEM7ENG4/6S5g==',key_name='tempest-TestMinimumBasicScenario-1717295520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-w6zrh540',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:49:26Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=567b856e-1a3b-4a12-8ead-d67b2154d18a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.objects.instance [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'pci_devices' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:49:28 user nova-compute[70374]:   <uuid>567b856e-1a3b-4a12-8ead-d67b2154d18a</uuid>
Jul 27 09:49:28 user nova-compute[70374]:   <name>instance-00000024</name>
Jul 27 09:49:28 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:49:28 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:49:28 user nova-compute[70374]:   <metadata>
Jul 27 09:49:28 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:49:28 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:49:28 user nova-compute[70374]:       <nova:name>tempest-TestMinimumBasicScenario-server-2042600824</nova:name>
Jul 27 09:49:28 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:49:28</nova:creationTime>
Jul 27 09:49:28 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:49:28 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:49:28 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:49:28 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:49:28 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:49:28 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:49:28 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:49:28 user nova-compute[70374]:       <nova:owner>
Jul 27 09:49:28 user nova-compute[70374]:         <nova:user uuid="229f3686d8184688b3ced860a5d7b07e">tempest-TestMinimumBasicScenario-1439165130-project-member</nova:user>
Jul 27 09:49:28 user nova-compute[70374]:         <nova:project uuid="ec51f550eb3b4bd8883b2242eb2905f7">tempest-TestMinimumBasicScenario-1439165130</nova:project>
Jul 27 09:49:28 user nova-compute[70374]:       </nova:owner>
Jul 27 09:49:28 user nova-compute[70374]:       <nova:root type="image" uuid="4bd68661-7500-4179-b5df-e32cecaf17a5"/>
Jul 27 09:49:28 user nova-compute[70374]:       <nova:ports>
Jul 27 09:49:28 user nova-compute[70374]:         <nova:port uuid="71322434-89a5-4567-bcca-b587128b0149">
Jul 27 09:49:28 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 09:49:28 user nova-compute[70374]:         </nova:port>
Jul 27 09:49:28 user nova-compute[70374]:       </nova:ports>
Jul 27 09:49:28 user nova-compute[70374]:     </nova:instance>
Jul 27 09:49:28 user nova-compute[70374]:   </metadata>
Jul 27 09:49:28 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:49:28 user nova-compute[70374]:     <system>
Jul 27 09:49:28 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:49:28 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:49:28 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:49:28 user nova-compute[70374]:       <entry name="serial">567b856e-1a3b-4a12-8ead-d67b2154d18a</entry>
Jul 27 09:49:28 user nova-compute[70374]:       <entry name="uuid">567b856e-1a3b-4a12-8ead-d67b2154d18a</entry>
Jul 27 09:49:28 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:49:28 user nova-compute[70374]:     </system>
Jul 27 09:49:28 user nova-compute[70374]:   </sysinfo>
Jul 27 09:49:28 user nova-compute[70374]:   <os>
Jul 27 09:49:28 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:49:28 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:49:28 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:49:28 user nova-compute[70374]:   </os>
Jul 27 09:49:28 user nova-compute[70374]:   <features>
Jul 27 09:49:28 user nova-compute[70374]:     <acpi/>
Jul 27 09:49:28 user nova-compute[70374]:     <apic/>
Jul 27 09:49:28 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:49:28 user nova-compute[70374]:   </features>
Jul 27 09:49:28 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:49:28 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:49:28 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:49:28 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:49:28 user nova-compute[70374]:   </clock>
Jul 27 09:49:28 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:49:28 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:49:28 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:49:28 user nova-compute[70374]:   </cpu>
Jul 27 09:49:28 user nova-compute[70374]:   <devices>
Jul 27 09:49:28 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:49:28 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:49:28 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk"/>
Jul 27 09:49:28 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:49:28 user nova-compute[70374]:     </disk>
Jul 27 09:49:28 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:49:28 user nova-compute[70374]:       <mac address="fa:16:3e:3c:1f:12"/>
Jul 27 09:49:28 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:49:28 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:49:28 user nova-compute[70374]:       <target dev="tap71322434-89"/>
Jul 27 09:49:28 user nova-compute[70374]:     </interface>
Jul 27 09:49:28 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:49:28 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/console.log" append="off"/>
Jul 27 09:49:28 user nova-compute[70374]:     </serial>
Jul 27 09:49:28 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:49:28 user nova-compute[70374]:     <video>
Jul 27 09:49:28 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:49:28 user nova-compute[70374]:     </video>
Jul 27 09:49:28 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:49:28 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:49:28 user nova-compute[70374]:     </rng>
Jul 27 09:49:28 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:49:28 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:49:28 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:49:28 user nova-compute[70374]:     </memballoon>
Jul 27 09:49:28 user nova-compute[70374]:   </devices>
Jul 27 09:49:28 user nova-compute[70374]: </domain>
Jul 27 09:49:28 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2042600824',display_name='tempest-TestMinimumBasicScenario-server-2042600824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2042600824',id=36,image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE1XN7Mz8irdJ5W8ZbQhTWChaYO4ff7cqi50Szx1yn/v3gWx2SJUQfHT4ZvHDw03qmc0t+d94JKmbOAcpHp88aF7kn3HcBC1m5pwTdaBhJDo8Y6s8TSSpEM7ENG4/6S5g==',key_name='tempest-TestMinimumBasicScenario-1717295520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-w6zrh540',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:49:26Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=567b856e-1a3b-4a12-8ead-d67b2154d18a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG os_vif [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71322434-89, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71322434-89, col_values=(('external_ids', {'iface-id': '71322434-89a5-4567-bcca-b587128b0149', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:1f:12', 'vm-uuid': '567b856e-1a3b-4a12-8ead-d67b2154d18a'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:28 user nova-compute[70374]: INFO os_vif [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89')
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No VIF found with MAC fa:16:3e:3c:1f:12, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-87e00d9d-72b3-4b7b-9c9b-afed2fc06a13 req-e1844051-8241-4077-a886-1d679e4c3d7e service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updated VIF entry in instance network info cache for port 71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-87e00d9d-72b3-4b7b-9c9b-afed2fc06a13 req-e1844051-8241-4077-a886-1d679e4c3d7e service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:49:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-87e00d9d-72b3-4b7b-9c9b-afed2fc06a13 req-e1844051-8241-4077-a886-1d679e4c3d7e service nova] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:49:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-1bce6c85-8f9b-41c8-924a-8a62311b6f3b req-7fecb407-c423-49f3-ae3a-a01fb631f17a service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:49:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1bce6c85-8f9b-41c8-924a-8a62311b6f3b req-7fecb407-c423-49f3-ae3a-a01fb631f17a service nova] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1bce6c85-8f9b-41c8-924a-8a62311b6f3b req-7fecb407-c423-49f3-ae3a-a01fb631f17a service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1bce6c85-8f9b-41c8-924a-8a62311b6f3b req-7fecb407-c423-49f3-ae3a-a01fb631f17a service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-1bce6c85-8f9b-41c8-924a-8a62311b6f3b req-7fecb407-c423-49f3-ae3a-a01fb631f17a service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] No waiting events found dispatching network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:49:29 user nova-compute[70374]: WARNING nova.compute.manager [req-1bce6c85-8f9b-41c8-924a-8a62311b6f3b req-7fecb407-c423-49f3-ae3a-a01fb631f17a service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received unexpected event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 for instance with vm_state building and task_state spawning.
Jul 27 09:49:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451371.8330014, 567b856e-1a3b-4a12-8ead-d67b2154d18a => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:49:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] VM Resumed (Lifecycle Event)
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:49:31 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Instance spawned successfully.
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:49:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451371.834267, 567b856e-1a3b-4a12-8ead-d67b2154d18a => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:49:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] VM Started (Lifecycle Event)
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:49:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:49:31 user nova-compute[70374]: INFO nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Took 5.94 seconds to spawn the instance on the hypervisor.
Jul 27 09:49:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:49:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Took 6.55 seconds to build instance.
Jul 27 09:49:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4308b62c-1b53-48ae-a181-e5156b1ff42e tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.638s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-153869ca-0f7e-49e9-bd9c-a3b6e103d601 req-613549cb-5e98-4aca-851e-47ac8e8d8bb5 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:49:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-153869ca-0f7e-49e9-bd9c-a3b6e103d601 req-613549cb-5e98-4aca-851e-47ac8e8d8bb5 service nova] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:49:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-153869ca-0f7e-49e9-bd9c-a3b6e103d601 req-613549cb-5e98-4aca-851e-47ac8e8d8bb5 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:49:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-153869ca-0f7e-49e9-bd9c-a3b6e103d601 req-613549cb-5e98-4aca-851e-47ac8e8d8bb5 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:49:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-153869ca-0f7e-49e9-bd9c-a3b6e103d601 req-613549cb-5e98-4aca-851e-47ac8e8d8bb5 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] No waiting events found dispatching network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:49:32 user nova-compute[70374]: WARNING nova.compute.manager [req-153869ca-0f7e-49e9-bd9c-a3b6e103d601 req-613549cb-5e98-4aca-851e-47ac8e8d8bb5 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received unexpected event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 for instance with vm_state active and task_state None.
Jul 27 09:49:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:49:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:49:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:49:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:49:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:49:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:49:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:50:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:50:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:50:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:50:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:50:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:50:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:50:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Going to confirm migration 2 {{(pid=70374) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 27 09:50:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:50:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquired lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:50:23 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:50:23 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'info_cache' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG nova.network.neutron [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Releasing lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG nova.objects.instance [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'migration_context' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.268s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.186s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:24 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Deleted allocation for migration 1be24ef9-97a0-4214-a545-74c336e706d3
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-1c716e7f-78a5-453f-82c5-5e5a30a9200f tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.196s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:26 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:50:26 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8335MB free_disk=25.37713623046875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 931b15c3-29a5-4b70-92d0-4c22fc1b9303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 4ece765d-2273-40d7-bb46-39d87fd0c819 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 567b856e-1a3b-4a12-8ead-d67b2154d18a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:50:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:50:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:50:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:50:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:50:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:50:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-a59e59a7-950b-41a6-9c28-b2c25f3be0f3 req-1f93eaf9-cd34-40fc-a7d5-7b18d6eee35c service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-changed-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:50:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-a59e59a7-950b-41a6-9c28-b2c25f3be0f3 req-1f93eaf9-cd34-40fc-a7d5-7b18d6eee35c service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Refreshing instance network info cache due to event network-changed-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:50:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a59e59a7-950b-41a6-9c28-b2c25f3be0f3 req-1f93eaf9-cd34-40fc-a7d5-7b18d6eee35c service nova] Acquiring lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:50:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a59e59a7-950b-41a6-9c28-b2c25f3be0f3 req-1f93eaf9-cd34-40fc-a7d5-7b18d6eee35c service nova] Acquired lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:50:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-a59e59a7-950b-41a6-9c28-b2c25f3be0f3 req-1f93eaf9-cd34-40fc-a7d5-7b18d6eee35c service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Refreshing network info cache for port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:50:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:50:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-a59e59a7-950b-41a6-9c28-b2c25f3be0f3 req-1f93eaf9-cd34-40fc-a7d5-7b18d6eee35c service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updated VIF entry in instance network info cache for port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:50:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-a59e59a7-950b-41a6-9c28-b2c25f3be0f3 req-1f93eaf9-cd34-40fc-a7d5-7b18d6eee35c service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating instance_info_cache with network_info: [{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:50:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a59e59a7-950b-41a6-9c28-b2c25f3be0f3 req-1f93eaf9-cd34-40fc-a7d5-7b18d6eee35c service nova] Releasing lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:50:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:38 user nova-compute[70374]: INFO nova.compute.manager [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Shelving
Jul 27 09:50:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-92cfa759-ff3a-4f2e-a090-825a4e24585d req-7441602f-597e-48dd-9f87-bb3edda1e7f9 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-unplugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-92cfa759-ff3a-4f2e-a090-825a4e24585d req-7441602f-597e-48dd-9f87-bb3edda1e7f9 service nova] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-92cfa759-ff3a-4f2e-a090-825a4e24585d req-7441602f-597e-48dd-9f87-bb3edda1e7f9 service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-92cfa759-ff3a-4f2e-a090-825a4e24585d req-7441602f-597e-48dd-9f87-bb3edda1e7f9 service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-92cfa759-ff3a-4f2e-a090-825a4e24585d req-7441602f-597e-48dd-9f87-bb3edda1e7f9 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] No waiting events found dispatching network-vif-unplugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:50:38 user nova-compute[70374]: WARNING nova.compute.manager [req-92cfa759-ff3a-4f2e-a090-825a4e24585d req-7441602f-597e-48dd-9f87-bb3edda1e7f9 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received unexpected event network-vif-unplugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c for instance with vm_state active and task_state shelving.
Jul 27 09:50:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:39 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance destroyed successfully.
Jul 27 09:50:39 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Beginning cold snapshot process
Jul 27 09:50:39 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:50:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk /opt/stack/data/nova/instances/snapshots/tmpx01jby43/2a9239e8662c44f390a036d6c29f70ad {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk /opt/stack/data/nova/instances/snapshots/tmpx01jby43/2a9239e8662c44f390a036d6c29f70ad" returned: 0 in 0.779s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:40 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Snapshot extracted, beginning image upload
Jul 27 09:50:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-ee9da410-5009-4d17-b38b-395419f50606 req-8f38e1f4-6336-464d-b990-c3b1d6ac7b2f service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:50:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ee9da410-5009-4d17-b38b-395419f50606 req-8f38e1f4-6336-464d-b990-c3b1d6ac7b2f service nova] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ee9da410-5009-4d17-b38b-395419f50606 req-8f38e1f4-6336-464d-b990-c3b1d6ac7b2f service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ee9da410-5009-4d17-b38b-395419f50606 req-8f38e1f4-6336-464d-b990-c3b1d6ac7b2f service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-ee9da410-5009-4d17-b38b-395419f50606 req-8f38e1f4-6336-464d-b990-c3b1d6ac7b2f service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] No waiting events found dispatching network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:50:40 user nova-compute[70374]: WARNING nova.compute.manager [req-ee9da410-5009-4d17-b38b-395419f50606 req-8f38e1f4-6336-464d-b990-c3b1d6ac7b2f service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received unexpected event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c for instance with vm_state active and task_state shelving_image_uploading.
Jul 27 09:50:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Snapshot image upload complete
Jul 27 09:50:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:50:42 user nova-compute[70374]: INFO nova.compute.manager [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Shelve offloading
Jul 27 09:50:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance destroyed successfully.
Jul 27 09:50:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:50:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:50:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquired lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:50:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.network.neutron [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating instance_info_cache with network_info: [{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Releasing lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance destroyed successfully.
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'resources' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-224474522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-224474522',id=35,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuV0qR/Ed0QIyRTfenNYTPSi1Xqznmf0lvxujvI1zqxuAvV4Lc0TIHQ/hKJ78U0OyU4woeLxnFhFf7LAGGX+doBW5PBY0NGNgTMGCx3E/qhixWZxAY4sc74cz3302cKoA==',key_name='tempest-keypair-1842228732',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-4dravgqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member',shelved_at='2023-07-27T09:50:42.580437',shelved_host='user',shelved_image_id='bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:50:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=4ece765d-2273-40d7-bb46-39d87fd0c819,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG os_vif [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbef25bb2-a1, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:50:43 user nova-compute[70374]: INFO os_vif [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1')
Jul 27 09:50:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Deleting instance files /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819_del
Jul 27 09:50:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Deletion of /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819_del complete
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-90ceb358-fb61-47fa-8898-6f92fd9169db req-2b77a67d-1901-4bdc-9fc6-310cdf3bf904 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-changed-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-90ceb358-fb61-47fa-8898-6f92fd9169db req-2b77a67d-1901-4bdc-9fc6-310cdf3bf904 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Refreshing instance network info cache due to event network-changed-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-90ceb358-fb61-47fa-8898-6f92fd9169db req-2b77a67d-1901-4bdc-9fc6-310cdf3bf904 service nova] Acquiring lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-90ceb358-fb61-47fa-8898-6f92fd9169db req-2b77a67d-1901-4bdc-9fc6-310cdf3bf904 service nova] Acquired lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-90ceb358-fb61-47fa-8898-6f92fd9169db req-2b77a67d-1901-4bdc-9fc6-310cdf3bf904 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Refreshing network info cache for port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:50:43 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Deleted allocations for instance 4ece765d-2273-40d7-bb46-39d87fd0c819
Jul 27 09:50:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:43 user nova-compute[70374]: DEBUG nova.objects.instance [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:50:44 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:50:44 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:50:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-2a137d1c-228a-4158-bf28-b684b4447a2f tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.605s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:44 user nova-compute[70374]: DEBUG nova.network.neutron [req-90ceb358-fb61-47fa-8898-6f92fd9169db req-2b77a67d-1901-4bdc-9fc6-310cdf3bf904 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updated VIF entry in instance network info cache for port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:50:44 user nova-compute[70374]: DEBUG nova.network.neutron [req-90ceb358-fb61-47fa-8898-6f92fd9169db req-2b77a67d-1901-4bdc-9fc6-310cdf3bf904 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating instance_info_cache with network_info: [{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:50:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-90ceb358-fb61-47fa-8898-6f92fd9169db req-2b77a67d-1901-4bdc-9fc6-310cdf3bf904 service nova] Releasing lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:47 user nova-compute[70374]: INFO nova.compute.manager [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Terminating instance
Jul 27 09:50:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-c2b4e3b2-3fb2-427f-b3fd-eb52d0b52ddd req-376b3555-cdf3-40e2-9db4-37697667354e service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c2b4e3b2-3fb2-427f-b3fd-eb52d0b52ddd req-376b3555-cdf3-40e2-9db4-37697667354e service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c2b4e3b2-3fb2-427f-b3fd-eb52d0b52ddd req-376b3555-cdf3-40e2-9db4-37697667354e service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c2b4e3b2-3fb2-427f-b3fd-eb52d0b52ddd req-376b3555-cdf3-40e2-9db4-37697667354e service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-c2b4e3b2-3fb2-427f-b3fd-eb52d0b52ddd req-376b3555-cdf3-40e2-9db4-37697667354e service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:50:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-c2b4e3b2-3fb2-427f-b3fd-eb52d0b52ddd req-376b3555-cdf3-40e2-9db4-37697667354e service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-unplugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:50:47 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Instance destroyed successfully.
Jul 27 09:50:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lazy-loading 'resources' on Instance uuid bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-320285733',display_name='tempest-ServerActionsTestOtherB-server-320285733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-320285733',id=31,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwM7s2ukMCjS9d1L6xeZ8V06/BlNsbdubpzYFQNylZ95oaZJvseXMRx61cDiQgQwhAnOrhztXtQDZhu6Q3c1okTJuAzGTGtrq/KpP2YpFcgHKs2/U9ssFAKS6769LlNPQ==',key_name='tempest-keypair-858669604',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6457496dd4d54638a58c4e731420e473',ramdisk_id='',reservation_id='r-k1fw99o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-247493366',owner_user_name='tempest-ServerActionsTestOtherB-247493366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='906960beba9548c1b0bfb37011957bd7',uuid=bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converting VIF {"id": "ad798508-8253-45fd-874b-abfa6dc1b966", "address": "fa:16:3e:d1:c6:60", "network": {"id": "56d0bb7e-b321-488b-9da8-2c79cabfc459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-199628034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6457496dd4d54638a58c4e731420e473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad798508-82", "ovs_interfaceid": "ad798508-8253-45fd-874b-abfa6dc1b966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_vif [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad798508-82, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:48 user nova-compute[70374]: INFO os_vif [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c6:60,bridge_name='br-int',has_traffic_filtering=True,id=ad798508-8253-45fd-874b-abfa6dc1b966,network=Network(56d0bb7e-b321-488b-9da8-2c79cabfc459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad798508-82')
Jul 27 09:50:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWKERxAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:50:48 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc467570-327b-44e0-9eb6-8b74b5ef5175]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:50:48 user nova-compute[70374]: No targets found.
Jul 27 09:50:48 user nova-compute[70374]: iSNS:
Jul 27 09:50:48 user nova-compute[70374]: No targets found.
Jul 27 09:50:48 user nova-compute[70374]: STATIC:
Jul 27 09:50:48 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401
Jul 27 09:50:48 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:50:48 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:50:48 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462
Jul 27 09:50:48 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:50:48 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:50:48 user nova-compute[70374]: FIRMWARE:
Jul 27 09:50:48 user nova-compute[70374]: No targets found.
Jul 27 09:50:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:50:48 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:50:48 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab9eae8-25c2-4dec-a760-447037903807]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ac9234-2b7b-4647-9024-c5b511f4bf6d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:50:48 user nova-compute[70374]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:50:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 (non-flash)
Jul 27 09:50:48 user nova-compute[70374]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:50:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc0e2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2638d1c-2654-405c-adb4-75b17a6eb6d8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ea1371-0a90-4d1f-a61f-fd39727386b1]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b00f60-5459-4735-8417-876282640edb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e20ba-83c9-468d-a835-af59be9b1f14]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc6cedf-7afa-4c21-b415-ca6f353e767a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3148fc4-739b-4277-aa44-349f89f00238]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260]
Jul 27 09:50:48 user nova-compute[70374]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462, portal: 172.16.0.220,3260] successful.
Jul 27 09:50:48 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc10fe-eff6-493c-be2c-90b8af41d462 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25f4209-4855-4015-845c-37dea0e45275]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] <== disconnect_volume: return (304ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:50:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Deleting instance files /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee_del
Jul 27 09:50:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Deletion of /opt/stack/data/nova/instances/bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee_del complete
Jul 27 09:50:48 user nova-compute[70374]: INFO nova.compute.manager [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 27 09:50:48 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:50:48 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:50:49 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:50:49 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Took 0.72 seconds to deallocate network for instance.
Jul 27 09:50:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-0bb8c51f-3600-49cf-9678-1aefb502284e req-92bad64c-6a25-4710-8d47-7e121dbff4be service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-deleted-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:50:49 user nova-compute[70374]: INFO nova.compute.manager [req-0bb8c51f-3600-49cf-9678-1aefb502284e req-92bad64c-6a25-4710-8d47-7e121dbff4be service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Neutron deleted interface ad798508-8253-45fd-874b-abfa6dc1b966; detaching it from the instance and deleting it from the info cache
Jul 27 09:50:49 user nova-compute[70374]: DEBUG nova.network.neutron [req-0bb8c51f-3600-49cf-9678-1aefb502284e req-92bad64c-6a25-4710-8d47-7e121dbff4be service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:50:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-0bb8c51f-3600-49cf-9678-1aefb502284e req-92bad64c-6a25-4710-8d47-7e121dbff4be service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Detach interface failed, port_id=ad798508-8253-45fd-874b-abfa6dc1b966, reason: Instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:50:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e5a525b-5e57-41ce-a0b2-74b68354fe3e req-5a73a4fb-6b85-4e14-b8a7-e0a87f0e123b service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:50:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e5a525b-5e57-41ce-a0b2-74b68354fe3e req-5a73a4fb-6b85-4e14-b8a7-e0a87f0e123b service nova] Acquiring lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e5a525b-5e57-41ce-a0b2-74b68354fe3e req-5a73a4fb-6b85-4e14-b8a7-e0a87f0e123b service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e5a525b-5e57-41ce-a0b2-74b68354fe3e req-5a73a4fb-6b85-4e14-b8a7-e0a87f0e123b service nova] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e5a525b-5e57-41ce-a0b2-74b68354fe3e req-5a73a4fb-6b85-4e14-b8a7-e0a87f0e123b service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] No waiting events found dispatching network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:50:49 user nova-compute[70374]: WARNING nova.compute.manager [req-5e5a525b-5e57-41ce-a0b2-74b68354fe3e req-5a73a4fb-6b85-4e14-b8a7-e0a87f0e123b service nova] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Received unexpected event network-vif-plugged-ad798508-8253-45fd-874b-abfa6dc1b966 for instance with vm_state active and task_state deleting.
Jul 27 09:50:49 user nova-compute[70374]: INFO nova.compute.manager [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Took 0.75 seconds to detach 1 volumes for instance.
Jul 27 09:50:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:50:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:50:50 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:50:50 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:50:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:50 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Deleted allocations for instance bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee
Jul 27 09:50:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba99d9f8-8102-4194-878d-e68fbde252c3 tempest-ServerActionsTestOtherB-247493366 tempest-ServerActionsTestOtherB-247493366-project-member] Lock "bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:50:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:50:54 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451439.1917207, 4ece765d-2273-40d7-bb46-39d87fd0c819 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:50:54 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] VM Stopped (Lifecycle Event)
Jul 27 09:50:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7153e486-feeb-47ca-9eb4-6d7fdc5cb6a2 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:50:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:51:02 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451447.993422, bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:51:02 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] VM Stopped (Lifecycle Event)
Jul 27 09:51:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d84c62f5-7ff5-441f-b3d7-2b44ae62794b None None] [instance: bd24fbdc-8c7a-4056-af7f-bd2dfce5d8ee] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:51:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:51:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:51:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:51:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:51:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:51:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'flavor' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:19 user nova-compute[70374]: INFO nova.compute.manager [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Attaching volume db058caf-412f-4b53-b884-93aa8a161d63 to /dev/vdb
Jul 27 09:51:19 user nova-compute[70374]: DEBUG os_brick.utils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bfab08-c2f4-4de0-b8e6-294a050e7171]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df13669-0f1b-429a-b196-ac4e20c5c72a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[08964dff-b283-460a-a5f2-3ba86a0c20c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3344055-3af4-4cf3-956e-586ef38c7c3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:51:19 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:51:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f484e6f-d6e3-4ed0-b4f5-e51ab09087c8]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG os_brick.utils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:51:19 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating existing volume attachment record: 8d849fc8-349c-46a5-9b4d-f1168b73dcab {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [{"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-931b15c3-29a5-4b70-92d0-4c22fc1b9303" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 09:51:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 09:51:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEPbKhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:51:25 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:51:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:51:25 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:51:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:51:25 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64cf228-202b-4c07-8c5b-567c5cfef057]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:51:25 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:25 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfd6563-dccc-47d2-999a-34174c929680]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63] added
Jul 27 09:51:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1526093-1e41-4a38-8110-4d883a66a2b8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b30d5b-2504-43ac-a64b-0fb99bf7f55a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeEPbKhJ {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeEPbKhJ" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[83599ea9-0618-4ea7-a530-4784a7f9c109]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MeEPbKhJ'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:51:26 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8525MB free_disk=25.37511444091797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4c44cd-726f-42de-9e82-ae08ac23a270]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a458b93d-cea7-4e13-a2b2-40f6ab34af66]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[694cac78-2cad-43b1-a3e9-0a9d25c6dcb6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260]
Jul 27 09:51:26 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260] successful.
Jul 27 09:51:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e3ae6c-47c0-41aa-953f-514a3995ce83]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f29d2-4d66-48b3-a33b-0988ebac9b40]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:26 user nova-compute[70374]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:51:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:26 user nova-compute[70374]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:51:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.627s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1664cf28-f286-405c-898c-f66b98ea9661]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEPbKhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 931b15c3-29a5-4b70-92d0-4c22fc1b9303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 567b856e-1a3b-4a12-8ead-d67b2154d18a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:51:26 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:51:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:51:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.659s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:51:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] <== connect_volume: return (1662ms) {'type': 'block', 'scsi_wwn': '26632313133663961', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:51:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632313133663961', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:51:27 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'flavor' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:51:27 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:51:27 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:51:27 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:51:27 user nova-compute[70374]:   <serial>db058caf-412f-4b53-b884-93aa8a161d63</serial>
Jul 27 09:51:27 user nova-compute[70374]: </disk>
Jul 27 09:51:27 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:51:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:51:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:51:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No VIF found with MAC fa:16:3e:3c:1f:12, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:51:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ab0dcedd-d1d4-455a-9186-26cf87f4f1a6 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.850s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 09:51:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:51:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-37fa7dcd-e9a2-4e81-bf77-89cb92624f1f req-f4d3371f-1538-453f-a0d0-c8b021b4d3ad service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-changed-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:51:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-37fa7dcd-e9a2-4e81-bf77-89cb92624f1f req-f4d3371f-1538-453f-a0d0-c8b021b4d3ad service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing instance network info cache due to event network-changed-71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:51:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-37fa7dcd-e9a2-4e81-bf77-89cb92624f1f req-f4d3371f-1538-453f-a0d0-c8b021b4d3ad service nova] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:51:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-37fa7dcd-e9a2-4e81-bf77-89cb92624f1f req-f4d3371f-1538-453f-a0d0-c8b021b4d3ad service nova] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:51:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-37fa7dcd-e9a2-4e81-bf77-89cb92624f1f req-f4d3371f-1538-453f-a0d0-c8b021b4d3ad service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing network info cache for port 71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:51:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:51:36 user nova-compute[70374]: DEBUG nova.network.neutron [req-37fa7dcd-e9a2-4e81-bf77-89cb92624f1f req-f4d3371f-1538-453f-a0d0-c8b021b4d3ad service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updated VIF entry in instance network info cache for port 71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:51:36 user nova-compute[70374]: DEBUG nova.network.neutron [req-37fa7dcd-e9a2-4e81-bf77-89cb92624f1f req-f4d3371f-1538-453f-a0d0-c8b021b4d3ad service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:51:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-37fa7dcd-e9a2-4e81-bf77-89cb92624f1f req-f4d3371f-1538-453f-a0d0-c8b021b4d3ad service nova] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:51:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-70ba2acf-07ab-48cf-8360-b522de699444 req-452ff851-ff5e-45fb-97b0-d15cdba268a5 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-changed-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:51:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-70ba2acf-07ab-48cf-8360-b522de699444 req-452ff851-ff5e-45fb-97b0-d15cdba268a5 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing instance network info cache due to event network-changed-71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:51:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70ba2acf-07ab-48cf-8360-b522de699444 req-452ff851-ff5e-45fb-97b0-d15cdba268a5 service nova] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:51:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70ba2acf-07ab-48cf-8360-b522de699444 req-452ff851-ff5e-45fb-97b0-d15cdba268a5 service nova] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:51:37 user nova-compute[70374]: DEBUG nova.network.neutron [req-70ba2acf-07ab-48cf-8360-b522de699444 req-452ff851-ff5e-45fb-97b0-d15cdba268a5 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing network info cache for port 71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:51:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-70ba2acf-07ab-48cf-8360-b522de699444 req-452ff851-ff5e-45fb-97b0-d15cdba268a5 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updated VIF entry in instance network info cache for port 71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:51:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-70ba2acf-07ab-48cf-8360-b522de699444 req-452ff851-ff5e-45fb-97b0-d15cdba268a5 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:51:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70ba2acf-07ab-48cf-8360-b522de699444 req-452ff851-ff5e-45fb-97b0-d15cdba268a5 service nova] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:51:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:42 user nova-compute[70374]: INFO nova.compute.manager [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Rebooting instance
Jul 27 09:51:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:51:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:51:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG nova.network.neutron [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-46c9a660-3573-4272-a058-e650ea31985a req-85c14d8a-1e17-4447-8afa-a10bb9844345 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-unplugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-46c9a660-3573-4272-a058-e650ea31985a req-85c14d8a-1e17-4447-8afa-a10bb9844345 service nova] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-46c9a660-3573-4272-a058-e650ea31985a req-85c14d8a-1e17-4447-8afa-a10bb9844345 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-46c9a660-3573-4272-a058-e650ea31985a req-85c14d8a-1e17-4447-8afa-a10bb9844345 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-46c9a660-3573-4272-a058-e650ea31985a req-85c14d8a-1e17-4447-8afa-a10bb9844345 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] No waiting events found dispatching network-vif-unplugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:51:43 user nova-compute[70374]: WARNING nova.compute.manager [req-46c9a660-3573-4272-a058-e650ea31985a req-85c14d8a-1e17-4447-8afa-a10bb9844345 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received unexpected event network-vif-unplugged-71322434-89a5-4567-bcca-b587128b0149 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 09:51:44 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Instance destroyed successfully.
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'resources' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2042600824',display_name='tempest-TestMinimumBasicScenario-server-2042600824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2042600824',id=36,image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE1XN7Mz8irdJ5W8ZbQhTWChaYO4ff7cqi50Szx1yn/v3gWx2SJUQfHT4ZvHDw03qmc0t+d94JKmbOAcpHp88aF7kn3HcBC1m5pwTdaBhJDo8Y6s8TSSpEM7ENG4/6S5g==',key_name='tempest-TestMinimumBasicScenario-1717295520',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:49:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-w6zrh540',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:51:43Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=567b856e-1a3b-4a12-8ead-d67b2154d18a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_vif [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71322434-89, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:51:44 user nova-compute[70374]: INFO os_vif [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89')
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEPbKhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:51:44 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[001913dd-4ce2-4590-a3a2-4668d5ae7d16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:51:44 user nova-compute[70374]: No targets found.
Jul 27 09:51:44 user nova-compute[70374]: iSNS:
Jul 27 09:51:44 user nova-compute[70374]: No targets found.
Jul 27 09:51:44 user nova-compute[70374]: STATIC:
Jul 27 09:51:44 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401
Jul 27 09:51:44 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:51:44 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:51:44 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63
Jul 27 09:51:44 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:51:44 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:51:44 user nova-compute[70374]: FIRMWARE:
Jul 27 09:51:44 user nova-compute[70374]: No targets found.
Jul 27 09:51:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:51:44 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:51:44 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8d9fcc-4e8c-4b90-ac83-8d3add149587]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee115e05-3d41-4528-8c8e-f7670d5235cd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:44 user nova-compute[70374]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:51:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:44 user nova-compute[70374]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:51:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5f1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54ecb35-cb57-48d4-bdd3-b7380a07929b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b28a01-2cc3-43be-85ee-988e2767a82c]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd2d35e-c647-45fe-b1f4-5bed0716ea52]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d1bbe-9041-4382-b635-bc56808d6359]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f4ce89-a156-438c-b2ed-15ead0a1938f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b556b82c-fa04-443f-b00c-7da9f78f8402]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260]
Jul 27 09:51:44 user nova-compute[70374]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260] successful.
Jul 27 09:51:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2134d6-f120-4fa7-8c64-44c3b30060b4]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] <== disconnect_volume: return (275ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Start _get_guest_xml network_info=[{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4bd68661-7500-4179-b5df-e32cecaf17a5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '4bd68661-7500-4179-b5df-e32cecaf17a5'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '8d849fc8-349c-46a5-9b4d-f1168b73dcab', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEPbKhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '567b856e-1a3b-4a12-8ead-d67b2154d18a', 'attached_at': '', 'detached_at': '', 'volume_id': 'db058caf-412f-4b53-b884-93aa8a161d63', 'serial': 'db058caf-412f-4b53-b884-93aa8a161d63'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:51:44 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:51:44 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4bd68661-7500-4179-b5df-e32cecaf17a5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'vcpu_model' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEPbKhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:51:44 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:51:44 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:51:44 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[78abc14f-3442-44e8-a363-2b3484c9c47a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:51:44 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cfaa7f-c444-4854-8bbf-348630fd0bf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63] added
Jul 27 09:51:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4600b61f-eb1f-4e46-8614-2f2da743e376]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dc7e40-71e5-4b33-a348-21da5576d888]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeEPbKhJ {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeEPbKhJ" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[656b2d3f-e98c-42c5-b03c-bdd05fedce60]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MeEPbKhJ'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dc04fe-596b-4566-a1aa-efc24ed09dbd]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e2c4c-3d1e-4aec-9e0c-a388c1570cf5]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfcbdf1-c87a-4b02-8b2e-f2825d540f13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260]
Jul 27 09:51:44 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260] successful.
Jul 27 09:51:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[211f5d0a-ca17-409c-9aac-a9f860f477da]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:51:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c98e4f-9159-4fce-a0a8-d7d6a88f5a23]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:45 user nova-compute[70374]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:51:45 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:51:45 user nova-compute[70374]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:51:45 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0423bf-1bad-41b3-806c-93035fd6c7cb]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEPbKhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-d5a3b965-8a80-45b6-9619-8a766a69bd56 req-93be9f29-6504-434b-9634-f3b8c5a2942a service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d5a3b965-8a80-45b6-9619-8a766a69bd56 req-93be9f29-6504-434b-9634-f3b8c5a2942a service nova] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d5a3b965-8a80-45b6-9619-8a766a69bd56 req-93be9f29-6504-434b-9634-f3b8c5a2942a service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d5a3b965-8a80-45b6-9619-8a766a69bd56 req-93be9f29-6504-434b-9634-f3b8c5a2942a service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-d5a3b965-8a80-45b6-9619-8a766a69bd56 req-93be9f29-6504-434b-9634-f3b8c5a2942a service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] No waiting events found dispatching network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:51:45 user nova-compute[70374]: WARNING nova.compute.manager [req-d5a3b965-8a80-45b6-9619-8a766a69bd56 req-93be9f29-6504-434b-9634-f3b8c5a2942a service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received unexpected event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 09:51:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26632313133663961', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632313133663961', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2042600824',display_name='tempest-TestMinimumBasicScenario-server-2042600824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2042600824',id=36,image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE1XN7Mz8irdJ5W8ZbQhTWChaYO4ff7cqi50Szx1yn/v3gWx2SJUQfHT4ZvHDw03qmc0t+d94JKmbOAcpHp88aF7kn3HcBC1m5pwTdaBhJDo8Y6s8TSSpEM7ENG4/6S5g==',key_name='tempest-TestMinimumBasicScenario-1717295520',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:49:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-w6zrh540',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:51:43Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=567b856e-1a3b-4a12-8ead-d67b2154d18a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'pci_devices' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:51:46 user nova-compute[70374]:   <uuid>567b856e-1a3b-4a12-8ead-d67b2154d18a</uuid>
Jul 27 09:51:46 user nova-compute[70374]:   <name>instance-00000024</name>
Jul 27 09:51:46 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:51:46 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:51:46 user nova-compute[70374]:   <metadata>
Jul 27 09:51:46 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:51:46 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:51:46 user nova-compute[70374]:       <nova:name>tempest-TestMinimumBasicScenario-server-2042600824</nova:name>
Jul 27 09:51:46 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:51:44</nova:creationTime>
Jul 27 09:51:46 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:51:46 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:51:46 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:51:46 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:51:46 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:51:46 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:51:46 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:51:46 user nova-compute[70374]:       <nova:owner>
Jul 27 09:51:46 user nova-compute[70374]:         <nova:user uuid="229f3686d8184688b3ced860a5d7b07e">tempest-TestMinimumBasicScenario-1439165130-project-member</nova:user>
Jul 27 09:51:46 user nova-compute[70374]:         <nova:project uuid="ec51f550eb3b4bd8883b2242eb2905f7">tempest-TestMinimumBasicScenario-1439165130</nova:project>
Jul 27 09:51:46 user nova-compute[70374]:       </nova:owner>
Jul 27 09:51:46 user nova-compute[70374]:       <nova:root type="image" uuid="4bd68661-7500-4179-b5df-e32cecaf17a5"/>
Jul 27 09:51:46 user nova-compute[70374]:       <nova:ports>
Jul 27 09:51:46 user nova-compute[70374]:         <nova:port uuid="71322434-89a5-4567-bcca-b587128b0149">
Jul 27 09:51:46 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 09:51:46 user nova-compute[70374]:         </nova:port>
Jul 27 09:51:46 user nova-compute[70374]:       </nova:ports>
Jul 27 09:51:46 user nova-compute[70374]:     </nova:instance>
Jul 27 09:51:46 user nova-compute[70374]:   </metadata>
Jul 27 09:51:46 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:51:46 user nova-compute[70374]:     <system>
Jul 27 09:51:46 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:51:46 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:51:46 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:51:46 user nova-compute[70374]:       <entry name="serial">567b856e-1a3b-4a12-8ead-d67b2154d18a</entry>
Jul 27 09:51:46 user nova-compute[70374]:       <entry name="uuid">567b856e-1a3b-4a12-8ead-d67b2154d18a</entry>
Jul 27 09:51:46 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:51:46 user nova-compute[70374]:     </system>
Jul 27 09:51:46 user nova-compute[70374]:   </sysinfo>
Jul 27 09:51:46 user nova-compute[70374]:   <os>
Jul 27 09:51:46 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:51:46 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:51:46 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:51:46 user nova-compute[70374]:   </os>
Jul 27 09:51:46 user nova-compute[70374]:   <features>
Jul 27 09:51:46 user nova-compute[70374]:     <acpi/>
Jul 27 09:51:46 user nova-compute[70374]:     <apic/>
Jul 27 09:51:46 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:51:46 user nova-compute[70374]:   </features>
Jul 27 09:51:46 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:51:46 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:51:46 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:51:46 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:51:46 user nova-compute[70374]:   </clock>
Jul 27 09:51:46 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:51:46 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:51:46 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:51:46 user nova-compute[70374]:   </cpu>
Jul 27 09:51:46 user nova-compute[70374]:   <devices>
Jul 27 09:51:46 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:51:46 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:51:46 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk"/>
Jul 27 09:51:46 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:51:46 user nova-compute[70374]:     </disk>
Jul 27 09:51:46 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:51:46 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:51:46 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 09:51:46 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:51:46 user nova-compute[70374]:       <serial>db058caf-412f-4b53-b884-93aa8a161d63</serial>
Jul 27 09:51:46 user nova-compute[70374]:     </disk>
Jul 27 09:51:46 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:51:46 user nova-compute[70374]:       <mac address="fa:16:3e:3c:1f:12"/>
Jul 27 09:51:46 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:51:46 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:51:46 user nova-compute[70374]:       <target dev="tap71322434-89"/>
Jul 27 09:51:46 user nova-compute[70374]:     </interface>
Jul 27 09:51:46 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:51:46 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/console.log" append="off"/>
Jul 27 09:51:46 user nova-compute[70374]:     </serial>
Jul 27 09:51:46 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:51:46 user nova-compute[70374]:     <video>
Jul 27 09:51:46 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:51:46 user nova-compute[70374]:     </video>
Jul 27 09:51:46 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:51:46 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:51:46 user nova-compute[70374]:     </rng>
Jul 27 09:51:46 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:51:46 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:51:46 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:51:46 user nova-compute[70374]:     </memballoon>
Jul 27 09:51:46 user nova-compute[70374]:   </devices>
Jul 27 09:51:46 user nova-compute[70374]: </domain>
Jul 27 09:51:46 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'trusted_certs' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Cannot resize image /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'migration_context' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2042600824',display_name='tempest-TestMinimumBasicScenario-server-2042600824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2042600824',id=36,image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE1XN7Mz8irdJ5W8ZbQhTWChaYO4ff7cqi50Szx1yn/v3gWx2SJUQfHT4ZvHDw03qmc0t+d94JKmbOAcpHp88aF7kn3HcBC1m5pwTdaBhJDo8Y6s8TSSpEM7ENG4/6S5g==',key_name='tempest-TestMinimumBasicScenario-1717295520',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:49:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-w6zrh540',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:51:43Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=567b856e-1a3b-4a12-8ead-d67b2154d18a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG os_vif [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71322434-89, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71322434-89, col_values=(('external_ids', {'iface-id': '71322434-89a5-4567-bcca-b587128b0149', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:1f:12', 'vm-uuid': '567b856e-1a3b-4a12-8ead-d67b2154d18a'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:51:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:46 user nova-compute[70374]: INFO os_vif [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89')
Jul 27 09:51:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-ac51a5ae-316d-41e5-b3da-6e11fbc76a20 req-ef56e7bf-ee9e-49f5-b6c4-6a8c31a22b41 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ac51a5ae-316d-41e5-b3da-6e11fbc76a20 req-ef56e7bf-ee9e-49f5-b6c4-6a8c31a22b41 service nova] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ac51a5ae-316d-41e5-b3da-6e11fbc76a20 req-ef56e7bf-ee9e-49f5-b6c4-6a8c31a22b41 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ac51a5ae-316d-41e5-b3da-6e11fbc76a20 req-ef56e7bf-ee9e-49f5-b6c4-6a8c31a22b41 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-ac51a5ae-316d-41e5-b3da-6e11fbc76a20 req-ef56e7bf-ee9e-49f5-b6c4-6a8c31a22b41 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] No waiting events found dispatching network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:51:48 user nova-compute[70374]: WARNING nova.compute.manager [req-ac51a5ae-316d-41e5-b3da-6e11fbc76a20 req-ef56e7bf-ee9e-49f5-b6c4-6a8c31a22b41 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received unexpected event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 09:51:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 567b856e-1a3b-4a12-8ead-d67b2154d18a due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451510.2483666, 567b856e-1a3b-4a12-8ead-d67b2154d18a => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:51:50 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] VM Resumed (Lifecycle Event)
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:51:50 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Instance rebooted successfully.
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:51:50 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451510.2542987, 567b856e-1a3b-4a12-8ead-d67b2154d18a => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:51:50 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] VM Started (Lifecycle Event)
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-753f2228-389c-486e-86c4-86d718bafbcc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.453s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-fe5e0096-f7b8-4e64-aeb6-ecd9d8c40294 req-841baed3-063d-4ca6-90f1-da5850216412 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe5e0096-f7b8-4e64-aeb6-ecd9d8c40294 req-841baed3-063d-4ca6-90f1-da5850216412 service nova] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe5e0096-f7b8-4e64-aeb6-ecd9d8c40294 req-841baed3-063d-4ca6-90f1-da5850216412 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fe5e0096-f7b8-4e64-aeb6-ecd9d8c40294 req-841baed3-063d-4ca6-90f1-da5850216412 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-fe5e0096-f7b8-4e64-aeb6-ecd9d8c40294 req-841baed3-063d-4ca6-90f1-da5850216412 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] No waiting events found dispatching network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:51:50 user nova-compute[70374]: WARNING nova.compute.manager [req-fe5e0096-f7b8-4e64-aeb6-ecd9d8c40294 req-841baed3-063d-4ca6-90f1-da5850216412 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received unexpected event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 for instance with vm_state active and task_state None.
Jul 27 09:51:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:51:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:51:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:51:57 user nova-compute[70374]: INFO nova.compute.claims [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Claim successful on node user
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.network.neutron [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:51:58 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.policy [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '653bb45e82be4371b55519bbf5308711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15442b359a014219b7854237eaaad0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:51:58 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Creating image(s)
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "/opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "/opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk 1073741824" returned: 0 in 0.049s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:51:58 user nova-compute[70374]: DEBUG nova.network.neutron [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Successfully created port: 73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Cannot resize image /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.objects.instance [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'migration_context' on Instance uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Ensure instance console log exists: /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.network.neutron [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Successfully updated port: 73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquired lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.network.neutron [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-3117f528-c0b9-4168-b16d-878363f192cd req-d7bfa27a-f185-4bd5-b7c2-a991f232e550 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received event network-changed-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-3117f528-c0b9-4168-b16d-878363f192cd req-d7bfa27a-f185-4bd5-b7c2-a991f232e550 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Refreshing instance network info cache due to event network-changed-73c76a81-a04f-4f93-9293-d1821de55355. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3117f528-c0b9-4168-b16d-878363f192cd req-d7bfa27a-f185-4bd5-b7c2-a991f232e550 service nova] Acquiring lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:51:59 user nova-compute[70374]: DEBUG nova.network.neutron [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.network.neutron [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Releasing lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Instance network_info: |[{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3117f528-c0b9-4168-b16d-878363f192cd req-d7bfa27a-f185-4bd5-b7c2-a991f232e550 service nova] Acquired lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.network.neutron [req-3117f528-c0b9-4168-b16d-878363f192cd req-d7bfa27a-f185-4bd5-b7c2-a991f232e550 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Refreshing network info cache for port 73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Start _get_guest_xml network_info=[{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:52:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:52:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:51:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1030901814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1030901814',id=37,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-680chxlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:51:58Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=ffe6d95c-b6cd-4d0b-a276-553b0800c630,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:aa:06,bridge_name='br-int',has_traffic_filtering=True,id=73c76a81-a04f-4f93-9293-d1821de55355,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c76a81-a0') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'pci_devices' on Instance uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:52:00 user nova-compute[70374]:   <uuid>ffe6d95c-b6cd-4d0b-a276-553b0800c630</uuid>
Jul 27 09:52:00 user nova-compute[70374]:   <name>instance-00000025</name>
Jul 27 09:52:00 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:52:00 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:52:00 user nova-compute[70374]:   <metadata>
Jul 27 09:52:00 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:52:00 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:52:00 user nova-compute[70374]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1030901814</nova:name>
Jul 27 09:52:00 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:52:00</nova:creationTime>
Jul 27 09:52:00 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:52:00 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:52:00 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:52:00 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:52:00 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:52:00 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:52:00 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:52:00 user nova-compute[70374]:       <nova:owner>
Jul 27 09:52:00 user nova-compute[70374]:         <nova:user uuid="653bb45e82be4371b55519bbf5308711">tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member</nova:user>
Jul 27 09:52:00 user nova-compute[70374]:         <nova:project uuid="15442b359a014219b7854237eaaad0d3">tempest-ServerBootFromVolumeStableRescueTest-1815884142</nova:project>
Jul 27 09:52:00 user nova-compute[70374]:       </nova:owner>
Jul 27 09:52:00 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:52:00 user nova-compute[70374]:       <nova:ports>
Jul 27 09:52:00 user nova-compute[70374]:         <nova:port uuid="73c76a81-a04f-4f93-9293-d1821de55355">
Jul 27 09:52:00 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 09:52:00 user nova-compute[70374]:         </nova:port>
Jul 27 09:52:00 user nova-compute[70374]:       </nova:ports>
Jul 27 09:52:00 user nova-compute[70374]:     </nova:instance>
Jul 27 09:52:00 user nova-compute[70374]:   </metadata>
Jul 27 09:52:00 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:52:00 user nova-compute[70374]:     <system>
Jul 27 09:52:00 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:52:00 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:52:00 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:52:00 user nova-compute[70374]:       <entry name="serial">ffe6d95c-b6cd-4d0b-a276-553b0800c630</entry>
Jul 27 09:52:00 user nova-compute[70374]:       <entry name="uuid">ffe6d95c-b6cd-4d0b-a276-553b0800c630</entry>
Jul 27 09:52:00 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:52:00 user nova-compute[70374]:     </system>
Jul 27 09:52:00 user nova-compute[70374]:   </sysinfo>
Jul 27 09:52:00 user nova-compute[70374]:   <os>
Jul 27 09:52:00 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:52:00 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:52:00 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:52:00 user nova-compute[70374]:   </os>
Jul 27 09:52:00 user nova-compute[70374]:   <features>
Jul 27 09:52:00 user nova-compute[70374]:     <acpi/>
Jul 27 09:52:00 user nova-compute[70374]:     <apic/>
Jul 27 09:52:00 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:52:00 user nova-compute[70374]:   </features>
Jul 27 09:52:00 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:52:00 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:52:00 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:52:00 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:52:00 user nova-compute[70374]:   </clock>
Jul 27 09:52:00 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:52:00 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:52:00 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:52:00 user nova-compute[70374]:   </cpu>
Jul 27 09:52:00 user nova-compute[70374]:   <devices>
Jul 27 09:52:00 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:52:00 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:52:00 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk"/>
Jul 27 09:52:00 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:52:00 user nova-compute[70374]:     </disk>
Jul 27 09:52:00 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:52:00 user nova-compute[70374]:       <mac address="fa:16:3e:59:aa:06"/>
Jul 27 09:52:00 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:52:00 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:52:00 user nova-compute[70374]:       <target dev="tap73c76a81-a0"/>
Jul 27 09:52:00 user nova-compute[70374]:     </interface>
Jul 27 09:52:00 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:52:00 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/console.log" append="off"/>
Jul 27 09:52:00 user nova-compute[70374]:     </serial>
Jul 27 09:52:00 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:52:00 user nova-compute[70374]:     <video>
Jul 27 09:52:00 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:52:00 user nova-compute[70374]:     </video>
Jul 27 09:52:00 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:52:00 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:52:00 user nova-compute[70374]:     </rng>
Jul 27 09:52:00 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:52:00 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:52:00 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:52:00 user nova-compute[70374]:     </memballoon>
Jul 27 09:52:00 user nova-compute[70374]:   </devices>
Jul 27 09:52:00 user nova-compute[70374]: </domain>
Jul 27 09:52:00 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:51:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1030901814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1030901814',id=37,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-680chxlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:51:58Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=ffe6d95c-b6cd-4d0b-a276-553b0800c630,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:aa:06,bridge_name='br-int',has_traffic_filtering=True,id=73c76a81-a04f-4f93-9293-d1821de55355,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c76a81-a0') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG os_vif [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:aa:06,bridge_name='br-int',has_traffic_filtering=True,id=73c76a81-a04f-4f93-9293-d1821de55355,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c76a81-a0') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73c76a81-a0, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73c76a81-a0, col_values=(('external_ids', {'iface-id': '73c76a81-a04f-4f93-9293-d1821de55355', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:aa:06', 'vm-uuid': 'ffe6d95c-b6cd-4d0b-a276-553b0800c630'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:00 user nova-compute[70374]: INFO os_vif [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:aa:06,bridge_name='br-int',has_traffic_filtering=True,id=73c76a81-a04f-4f93-9293-d1821de55355,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c76a81-a0')
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No VIF found with MAC fa:16:3e:59:aa:06, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.network.neutron [req-3117f528-c0b9-4168-b16d-878363f192cd req-d7bfa27a-f185-4bd5-b7c2-a991f232e550 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updated VIF entry in instance network info cache for port 73c76a81-a04f-4f93-9293-d1821de55355. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG nova.network.neutron [req-3117f528-c0b9-4168-b16d-878363f192cd req-d7bfa27a-f185-4bd5-b7c2-a991f232e550 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:52:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3117f528-c0b9-4168-b16d-878363f192cd req-d7bfa27a-f185-4bd5-b7c2-a991f232e550 service nova] Releasing lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-6c8c615c-109a-4adb-8a12-6b48a63c8bb7 req-afbc5525-81e4-40b2-b668-fe1137a90b05 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received event network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6c8c615c-109a-4adb-8a12-6b48a63c8bb7 req-afbc5525-81e4-40b2-b668-fe1137a90b05 service nova] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6c8c615c-109a-4adb-8a12-6b48a63c8bb7 req-afbc5525-81e4-40b2-b668-fe1137a90b05 service nova] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6c8c615c-109a-4adb-8a12-6b48a63c8bb7 req-afbc5525-81e4-40b2-b668-fe1137a90b05 service nova] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-6c8c615c-109a-4adb-8a12-6b48a63c8bb7 req-afbc5525-81e4-40b2-b668-fe1137a90b05 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] No waiting events found dispatching network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:52:01 user nova-compute[70374]: WARNING nova.compute.manager [req-6c8c615c-109a-4adb-8a12-6b48a63c8bb7 req-afbc5525-81e4-40b2-b668-fe1137a90b05 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received unexpected event network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 for instance with vm_state building and task_state spawning.
Jul 27 09:52:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451523.6460392, ffe6d95c-b6cd-4d0b-a276-553b0800c630 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:52:03 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] VM Resumed (Lifecycle Event)
Jul 27 09:52:03 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Instance spawned successfully.
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:52:03 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451523.6463947, ffe6d95c-b6cd-4d0b-a276-553b0800c630 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:52:03 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] VM Started (Lifecycle Event)
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:52:03 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:52:03 user nova-compute[70374]: INFO nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Took 5.42 seconds to spawn the instance on the hypervisor.
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:52:03 user nova-compute[70374]: INFO nova.compute.manager [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Took 6.00 seconds to build instance.
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-734ac883-e014-4a61-8296-1e8aaf809442 req-00381929-0fbd-486e-9ccf-660c3d42c19b service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received event network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-734ac883-e014-4a61-8296-1e8aaf809442 req-00381929-0fbd-486e-9ccf-660c3d42c19b service nova] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-734ac883-e014-4a61-8296-1e8aaf809442 req-00381929-0fbd-486e-9ccf-660c3d42c19b service nova] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-734ac883-e014-4a61-8296-1e8aaf809442 req-00381929-0fbd-486e-9ccf-660c3d42c19b service nova] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:03 user nova-compute[70374]: DEBUG nova.compute.manager [req-734ac883-e014-4a61-8296-1e8aaf809442 req-00381929-0fbd-486e-9ccf-660c3d42c19b service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] No waiting events found dispatching network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:52:03 user nova-compute[70374]: WARNING nova.compute.manager [req-734ac883-e014-4a61-8296-1e8aaf809442 req-00381929-0fbd-486e-9ccf-660c3d42c19b service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received unexpected event network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 for instance with vm_state active and task_state None.
Jul 27 09:52:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-256c3d7a-2292-4273-81a7-34dffa0754cd tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.094s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:14 user nova-compute[70374]: INFO nova.compute.manager [None req-5840c005-8554-40b0-8e34-79b0cbef4a77 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Get console output
Jul 27 09:52:14 user nova-compute[70374]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 27 09:52:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:52:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:52:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:52:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:52:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:52:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:52:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:52:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:52:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:27 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:52:27 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8263MB free_disk=25.343250274658203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 931b15c3-29a5-4b70-92d0-4c22fc1b9303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 567b856e-1a3b-4a12-8ead-d67b2154d18a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:52:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:31 user nova-compute[70374]: INFO nova.compute.manager [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Unshelving
Jul 27 09:52:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:31 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'pci_requests' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:52:31 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:52:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:52:31 user nova-compute[70374]: INFO nova.compute.claims [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Claim successful on node user
Jul 27 09:52:31 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:52:31 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:52:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:31 user nova-compute[70374]: INFO nova.network.neutron [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 09:52:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:52:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquired lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:52:32 user nova-compute[70374]: DEBUG nova.network.neutron [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:52:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-9aad63a2-756b-4c08-a095-fb49c6242ce9 req-d025c66c-2bac-47a2-bb5d-68fd8c533bec service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-changed-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:52:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-9aad63a2-756b-4c08-a095-fb49c6242ce9 req-d025c66c-2bac-47a2-bb5d-68fd8c533bec service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Refreshing instance network info cache due to event network-changed-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:52:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9aad63a2-756b-4c08-a095-fb49c6242ce9 req-d025c66c-2bac-47a2-bb5d-68fd8c533bec service nova] Acquiring lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating instance_info_cache with network_info: [{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Releasing lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:52:33 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Creating image(s)
Jul 27 09:52:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9aad63a2-756b-4c08-a095-fb49c6242ce9 req-d025c66c-2bac-47a2-bb5d-68fd8c533bec service nova] Acquired lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-9aad63a2-756b-4c08-a095-fb49c6242ce9 req-d025c66c-2bac-47a2-bb5d-68fd8c533bec service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Refreshing network info cache for port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "203720f9500ec23ca189a16e274863a29cc112ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "203720f9500ec23ca189a16e274863a29cc112ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca.part --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG nova.virt.images [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2 was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca.part /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-9aad63a2-756b-4c08-a095-fb49c6242ce9 req-d025c66c-2bac-47a2-bb5d-68fd8c533bec service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updated VIF entry in instance network info cache for port bef25bb2-a169-4d36-b13f-ac8fd72b5d2c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-9aad63a2-756b-4c08-a095-fb49c6242ce9 req-d025c66c-2bac-47a2-bb5d-68fd8c533bec service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating instance_info_cache with network_info: [{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9aad63a2-756b-4c08-a095-fb49c6242ce9 req-d025c66c-2bac-47a2-bb5d-68fd8c533bec service nova] Releasing lock "refresh_cache-4ece765d-2273-40d7-bb46-39d87fd0c819" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca.part /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca.converted" returned: 0 in 0.582s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "203720f9500ec23ca189a16e274863a29cc112ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.900s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "203720f9500ec23ca189a16e274863a29cc112ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "203720f9500ec23ca189a16e274863a29cc112ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca,backing_fmt=raw /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca,backing_fmt=raw /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk 1073741824" returned: 0 in 0.052s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "203720f9500ec23ca189a16e274863a29cc112ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'migration_context' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:52:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Rebasing disk image.
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.130s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 -F raw /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 -F raw /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk" returned: 0 in 2.404s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Ensure instance console log exists: /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Start _get_guest_xml network_info=[{"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8dcef4b869b3167da5fe8cae9bbf55b5',container_format='bare',created_at=2023-07-27T09:50:39Z,direct_url=<?>,disk_format='qcow2',id=bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-224474522-shelved',owner='5d32e43d96bc4f0a99fd3378c1677fb7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T09:50:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:52:38 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:52:38 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8dcef4b869b3167da5fe8cae9bbf55b5',container_format='bare',created_at=2023-07-27T09:50:39Z,direct_url=<?>,disk_format='qcow2',id=bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-224474522-shelved',owner='5d32e43d96bc4f0a99fd3378c1677fb7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T09:50:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-224474522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-224474522',id=35,image_ref='bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1842228732',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-4dravgqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member',shelved_at='2023-07-27T09:50:42.580437',shelved_host='user',shelved_image_id='bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:52:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=4ece765d-2273-40d7-bb46-39d87fd0c819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:52:38 user nova-compute[70374]:   <uuid>4ece765d-2273-40d7-bb46-39d87fd0c819</uuid>
Jul 27 09:52:38 user nova-compute[70374]:   <name>instance-00000023</name>
Jul 27 09:52:38 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:52:38 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:52:38 user nova-compute[70374]:   <metadata>
Jul 27 09:52:38 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:52:38 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:52:38 user nova-compute[70374]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-224474522</nova:name>
Jul 27 09:52:38 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:52:38</nova:creationTime>
Jul 27 09:52:38 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:52:38 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:52:38 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:52:38 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:52:38 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:52:38 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:52:38 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:52:38 user nova-compute[70374]:       <nova:owner>
Jul 27 09:52:38 user nova-compute[70374]:         <nova:user uuid="377915ad2c6e4244b5bd1a7ed97c6afb">tempest-AttachVolumeShelveTestJSON-1605888290-project-member</nova:user>
Jul 27 09:52:38 user nova-compute[70374]:         <nova:project uuid="5d32e43d96bc4f0a99fd3378c1677fb7">tempest-AttachVolumeShelveTestJSON-1605888290</nova:project>
Jul 27 09:52:38 user nova-compute[70374]:       </nova:owner>
Jul 27 09:52:38 user nova-compute[70374]:       <nova:root type="image" uuid="bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2"/>
Jul 27 09:52:38 user nova-compute[70374]:       <nova:ports>
Jul 27 09:52:38 user nova-compute[70374]:         <nova:port uuid="bef25bb2-a169-4d36-b13f-ac8fd72b5d2c">
Jul 27 09:52:38 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 09:52:38 user nova-compute[70374]:         </nova:port>
Jul 27 09:52:38 user nova-compute[70374]:       </nova:ports>
Jul 27 09:52:38 user nova-compute[70374]:     </nova:instance>
Jul 27 09:52:38 user nova-compute[70374]:   </metadata>
Jul 27 09:52:38 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:52:38 user nova-compute[70374]:     <system>
Jul 27 09:52:38 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:52:38 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:52:38 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:52:38 user nova-compute[70374]:       <entry name="serial">4ece765d-2273-40d7-bb46-39d87fd0c819</entry>
Jul 27 09:52:38 user nova-compute[70374]:       <entry name="uuid">4ece765d-2273-40d7-bb46-39d87fd0c819</entry>
Jul 27 09:52:38 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:52:38 user nova-compute[70374]:     </system>
Jul 27 09:52:38 user nova-compute[70374]:   </sysinfo>
Jul 27 09:52:38 user nova-compute[70374]:   <os>
Jul 27 09:52:38 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:52:38 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:52:38 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:52:38 user nova-compute[70374]:   </os>
Jul 27 09:52:38 user nova-compute[70374]:   <features>
Jul 27 09:52:38 user nova-compute[70374]:     <acpi/>
Jul 27 09:52:38 user nova-compute[70374]:     <apic/>
Jul 27 09:52:38 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:52:38 user nova-compute[70374]:   </features>
Jul 27 09:52:38 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:52:38 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:52:38 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:52:38 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:52:38 user nova-compute[70374]:   </clock>
Jul 27 09:52:38 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:52:38 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:52:38 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:52:38 user nova-compute[70374]:   </cpu>
Jul 27 09:52:38 user nova-compute[70374]:   <devices>
Jul 27 09:52:38 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:52:38 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:52:38 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk"/>
Jul 27 09:52:38 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:52:38 user nova-compute[70374]:     </disk>
Jul 27 09:52:38 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:52:38 user nova-compute[70374]:       <mac address="fa:16:3e:95:c9:e3"/>
Jul 27 09:52:38 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:52:38 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:52:38 user nova-compute[70374]:       <target dev="tapbef25bb2-a1"/>
Jul 27 09:52:38 user nova-compute[70374]:     </interface>
Jul 27 09:52:38 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:52:38 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/console.log" append="off"/>
Jul 27 09:52:38 user nova-compute[70374]:     </serial>
Jul 27 09:52:38 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:52:38 user nova-compute[70374]:     <video>
Jul 27 09:52:38 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:52:38 user nova-compute[70374]:     </video>
Jul 27 09:52:38 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:52:38 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:52:38 user nova-compute[70374]:     </rng>
Jul 27 09:52:38 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:52:38 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:52:38 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:52:38 user nova-compute[70374]:     </memballoon>
Jul 27 09:52:38 user nova-compute[70374]:   </devices>
Jul 27 09:52:38 user nova-compute[70374]: </domain>
Jul 27 09:52:38 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-224474522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-224474522',id=35,image_ref='bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1842228732',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-4dravgqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member',shelved_at='2023-07-27T09:50:42.580437',shelved_host='user',shelved_image_id='bca2ffcb-e6a3-4b44-9092-e8f4ad3ceea2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:52:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=4ece765d-2273-40d7-bb46-39d87fd0c819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG os_vif [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbef25bb2-a1, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbef25bb2-a1, col_values=(('external_ids', {'iface-id': 'bef25bb2-a169-4d36-b13f-ac8fd72b5d2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:c9:e3', 'vm-uuid': '4ece765d-2273-40d7-bb46-39d87fd0c819'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:38 user nova-compute[70374]: INFO os_vif [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1')
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:52:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] No VIF found with MAC fa:16:3e:95:c9:e3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:52:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-f03e6aeb-8368-4d54-9cb1-be97091bd0e8 req-e0970290-2d0c-4ee1-a4a0-234b5e43c2d6 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:52:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f03e6aeb-8368-4d54-9cb1-be97091bd0e8 req-e0970290-2d0c-4ee1-a4a0-234b5e43c2d6 service nova] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f03e6aeb-8368-4d54-9cb1-be97091bd0e8 req-e0970290-2d0c-4ee1-a4a0-234b5e43c2d6 service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f03e6aeb-8368-4d54-9cb1-be97091bd0e8 req-e0970290-2d0c-4ee1-a4a0-234b5e43c2d6 service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-f03e6aeb-8368-4d54-9cb1-be97091bd0e8 req-e0970290-2d0c-4ee1-a4a0-234b5e43c2d6 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] No waiting events found dispatching network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:52:39 user nova-compute[70374]: WARNING nova.compute.manager [req-f03e6aeb-8368-4d54-9cb1-be97091bd0e8 req-e0970290-2d0c-4ee1-a4a0-234b5e43c2d6 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received unexpected event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 09:52:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451561.8379438, 4ece765d-2273-40d7-bb46-39d87fd0c819 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:52:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] VM Resumed (Lifecycle Event)
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:52:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance spawned successfully.
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-26630cb1-90fe-4dd0-93b5-4865b58e70ab req-42841ca2-afea-4e04-a2a8-6da30b2a2d87 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-26630cb1-90fe-4dd0-93b5-4865b58e70ab req-42841ca2-afea-4e04-a2a8-6da30b2a2d87 service nova] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-26630cb1-90fe-4dd0-93b5-4865b58e70ab req-42841ca2-afea-4e04-a2a8-6da30b2a2d87 service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-26630cb1-90fe-4dd0-93b5-4865b58e70ab req-42841ca2-afea-4e04-a2a8-6da30b2a2d87 service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-26630cb1-90fe-4dd0-93b5-4865b58e70ab req-42841ca2-afea-4e04-a2a8-6da30b2a2d87 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] No waiting events found dispatching network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:52:41 user nova-compute[70374]: WARNING nova.compute.manager [req-26630cb1-90fe-4dd0-93b5-4865b58e70ab req-42841ca2-afea-4e04-a2a8-6da30b2a2d87 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received unexpected event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 09:52:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451561.8392243, 4ece765d-2273-40d7-bb46-39d87fd0c819 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:52:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] VM Started (Lifecycle Event)
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:52:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:52:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:52:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:52:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ef53db7a-a808-469a-8f13-a49a3dc0c0a4 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.752s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:52:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:52:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:52:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:52:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:52:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:52:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:52:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:52:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:52:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:52:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:52:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:53:15 user nova-compute[70374]: INFO nova.compute.manager [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Terminating instance
Jul 27 09:53:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-b561d8f3-7865-4393-9416-b1270912ba86 req-bcdd9882-1db5-4370-bef0-9b9e9ad479a7 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-unplugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b561d8f3-7865-4393-9416-b1270912ba86 req-bcdd9882-1db5-4370-bef0-9b9e9ad479a7 service nova] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b561d8f3-7865-4393-9416-b1270912ba86 req-bcdd9882-1db5-4370-bef0-9b9e9ad479a7 service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b561d8f3-7865-4393-9416-b1270912ba86 req-bcdd9882-1db5-4370-bef0-9b9e9ad479a7 service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-b561d8f3-7865-4393-9416-b1270912ba86 req-bcdd9882-1db5-4370-bef0-9b9e9ad479a7 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] No waiting events found dispatching network-vif-unplugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG nova.compute.manager [req-b561d8f3-7865-4393-9416-b1270912ba86 req-bcdd9882-1db5-4370-bef0-9b9e9ad479a7 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-unplugged-8688b83f-7507-454f-8b59-2a3293ca896d for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:16 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Instance destroyed successfully.
Jul 27 09:53:16 user nova-compute[70374]: DEBUG nova.objects.instance [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'resources' on Instance uuid 931b15c3-29a5-4b70-92d0-4c22fc1b9303 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1415728061',display_name='tempest-ServerActionsTestOtherA-server-1415728061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1415728061',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:48:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-ym8no9e5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:50:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=931b15c3-29a5-4b70-92d0-4c22fc1b9303,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "8688b83f-7507-454f-8b59-2a3293ca896d", "address": "fa:16:3e:5c:df:ee", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8688b83f-75", "ovs_interfaceid": "8688b83f-7507-454f-8b59-2a3293ca896d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_vif [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8688b83f-75, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:53:16 user nova-compute[70374]: INFO os_vif [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:df:ee,bridge_name='br-int',has_traffic_filtering=True,id=8688b83f-7507-454f-8b59-2a3293ca896d,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8688b83f-75')
Jul 27 09:53:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXFjoRIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:53:16 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aba417-b94e-49b5-8087-73147cc79079]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:53:16 user nova-compute[70374]: No targets found.
Jul 27 09:53:16 user nova-compute[70374]: iSNS:
Jul 27 09:53:16 user nova-compute[70374]: No targets found.
Jul 27 09:53:16 user nova-compute[70374]: STATIC:
Jul 27 09:53:16 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401
Jul 27 09:53:16 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:53:16 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:53:16 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63
Jul 27 09:53:16 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:53:16 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:53:16 user nova-compute[70374]: FIRMWARE:
Jul 27 09:53:16 user nova-compute[70374]: No targets found.
Jul 27 09:53:16 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:53:16 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:53:16 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9634618-8113-482a-9924-dbf453a26e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ace9fc8-27dc-4d2f-905b-0e47b6f7b78e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:53:16 user nova-compute[70374]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:53:16 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 (non-flash)
Jul 27 09:53:16 user nova-compute[70374]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:53:16 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc222830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[959fc374-2a34-4883-8f2a-f74f1c1962b3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f874c10-e0c0-42ec-94f1-1c388cee4936]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a576e-a98c-4667-a5ec-9acb057ea386]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d351e5-4554-4ec7-906d-6242c6de8662]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23939316332346330', '/dev/disk/by-id/scsi-1SCST_BIOf817ade4-991c24c05954d8f9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f817ade4') {{(pid=82164) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e2c065-3dfe-4ee8-a3b6-4408e9be6f2d]: (4, None) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5e88ab-5612-4399-8b5f-91016f70ef27]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc85a91a-6a42-4eb8-8585-01671e56d90a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260]
Jul 27 09:53:16 user nova-compute[70374]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401, portal: 172.16.0.220,3260] successful.
Jul 27 09:53:16 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4a7fb-6c06-4202-b289-a51813df1401 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b8ee3-2251-4f7e-946d-aaed87c38b08]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] <== disconnect_volume: return (310ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:53:16 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Deleting instance files /opt/stack/data/nova/instances/931b15c3-29a5-4b70-92d0-4c22fc1b9303_del
Jul 27 09:53:16 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Deletion of /opt/stack/data/nova/instances/931b15c3-29a5-4b70-92d0-4c22fc1b9303_del complete
Jul 27 09:53:16 user nova-compute[70374]: INFO nova.compute.manager [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 27 09:53:16 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:53:16 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:53:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-2e9a2880-ea74-4b0e-9f2c-b4b328fc22a3 req-348fafcb-fd38-430a-a9f3-bbebf2e17dc0 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:53:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2e9a2880-ea74-4b0e-9f2c-b4b328fc22a3 req-348fafcb-fd38-430a-a9f3-bbebf2e17dc0 service nova] Acquiring lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:53:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2e9a2880-ea74-4b0e-9f2c-b4b328fc22a3 req-348fafcb-fd38-430a-a9f3-bbebf2e17dc0 service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:53:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2e9a2880-ea74-4b0e-9f2c-b4b328fc22a3 req-348fafcb-fd38-430a-a9f3-bbebf2e17dc0 service nova] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:53:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-2e9a2880-ea74-4b0e-9f2c-b4b328fc22a3 req-348fafcb-fd38-430a-a9f3-bbebf2e17dc0 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] No waiting events found dispatching network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:53:17 user nova-compute[70374]: WARNING nova.compute.manager [req-2e9a2880-ea74-4b0e-9f2c-b4b328fc22a3 req-348fafcb-fd38-430a-a9f3-bbebf2e17dc0 service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received unexpected event network-vif-plugged-8688b83f-7507-454f-8b59-2a3293ca896d for instance with vm_state active and task_state deleting.
Jul 27 09:53:17 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:53:17 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Took 1.22 seconds to deallocate network for instance.
Jul 27 09:53:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-782c25bc-1cd5-4ca3-99e7-813e12864be4 req-0dc2c6fb-bcf6-4ef9-b9d9-4afbb4a223bb service nova] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Received event network-vif-deleted-8688b83f-7507-454f-8b59-2a3293ca896d {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:53:18 user nova-compute[70374]: INFO nova.compute.manager [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Took 0.72 seconds to detach 1 volumes for instance.
Jul 27 09:53:18 user nova-compute[70374]: DEBUG nova.compute.manager [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Deleting volume: 07b4a7fb-6c06-4202-b289-a51813df1401 {{(pid=70374) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 09:53:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:53:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:53:18 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:53:18 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:53:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:53:18 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Deleted allocations for instance 931b15c3-29a5-4b70-92d0-4c22fc1b9303
Jul 27 09:53:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-865e0bdc-7338-40a5-9b79-09b9a5b79b91 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "931b15c3-29a5-4b70-92d0-4c22fc1b9303" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.605s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:53:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [{"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-206f2727-3adb-4f39-b1d6-4ec1352e8cf8" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:53:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:29 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:53:29 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8340MB free_disk=25.316448211669922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 567b856e-1a3b-4a12-8ead-d67b2154d18a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 4ece765d-2273-40d7-bb46-39d87fd0c819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:53:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:53:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:53:31 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451596.200806, 931b15c3-29a5-4b70-92d0-4c22fc1b9303 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:53:31 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] VM Stopped (Lifecycle Event)
Jul 27 09:53:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-180f0183-f5a2-407e-9515-a9648bf24cc3 None None] [instance: 931b15c3-29a5-4b70-92d0-4c22fc1b9303] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:53:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:53:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-d8ef23c6-d5c4-4a5f-9efb-21027479dfbd req-6a7e7668-9d86-42c7-b30d-e797f839008b service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-changed-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:53:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-d8ef23c6-d5c4-4a5f-9efb-21027479dfbd req-6a7e7668-9d86-42c7-b30d-e797f839008b service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing instance network info cache due to event network-changed-71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:53:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d8ef23c6-d5c4-4a5f-9efb-21027479dfbd req-6a7e7668-9d86-42c7-b30d-e797f839008b service nova] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:53:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d8ef23c6-d5c4-4a5f-9efb-21027479dfbd req-6a7e7668-9d86-42c7-b30d-e797f839008b service nova] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:53:34 user nova-compute[70374]: DEBUG nova.network.neutron [req-d8ef23c6-d5c4-4a5f-9efb-21027479dfbd req-6a7e7668-9d86-42c7-b30d-e797f839008b service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing network info cache for port 71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-d8ef23c6-d5c4-4a5f-9efb-21027479dfbd req-6a7e7668-9d86-42c7-b30d-e797f839008b service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updated VIF entry in instance network info cache for port 71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-d8ef23c6-d5c4-4a5f-9efb-21027479dfbd req-6a7e7668-9d86-42c7-b30d-e797f839008b service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d8ef23c6-d5c4-4a5f-9efb-21027479dfbd req-6a7e7668-9d86-42c7-b30d-e797f839008b service nova] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-0b6f86ad-eec9-420d-9b27-97e2b16507e3 req-9fd72b8d-8d86-48fb-80d5-c487abdcc162 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-changed-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-0b6f86ad-eec9-420d-9b27-97e2b16507e3 req-9fd72b8d-8d86-48fb-80d5-c487abdcc162 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing instance network info cache due to event network-changed-71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0b6f86ad-eec9-420d-9b27-97e2b16507e3 req-9fd72b8d-8d86-48fb-80d5-c487abdcc162 service nova] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0b6f86ad-eec9-420d-9b27-97e2b16507e3 req-9fd72b8d-8d86-48fb-80d5-c487abdcc162 service nova] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.network.neutron [req-0b6f86ad-eec9-420d-9b27-97e2b16507e3 req-9fd72b8d-8d86-48fb-80d5-c487abdcc162 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Refreshing network info cache for port 71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:53:35 user nova-compute[70374]: INFO nova.compute.manager [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Detaching volume db058caf-412f-4b53-b884-93aa8a161d63
Jul 27 09:53:35 user nova-compute[70374]: INFO nova.virt.block_device [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Attempting to driver detach volume db058caf-412f-4b53-b884-93aa8a161d63 from mountpoint /dev/vdb
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Attempting to detach device vdb from instance 567b856e-1a3b-4a12-8ead-d67b2154d18a from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:53:35 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:53:35 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:53:35 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:53:35 user nova-compute[70374]:   <serial>db058caf-412f-4b53-b884-93aa8a161d63</serial>
Jul 27 09:53:35 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 09:53:35 user nova-compute[70374]: </disk>
Jul 27 09:53:35 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:53:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully detached device vdb from instance 567b856e-1a3b-4a12-8ead-d67b2154d18a from the persistent domain config.
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 567b856e-1a3b-4a12-8ead-d67b2154d18a from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:53:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:53:35 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:53:35 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 09:53:35 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:53:35 user nova-compute[70374]:   <serial>db058caf-412f-4b53-b884-93aa8a161d63</serial>
Jul 27 09:53:35 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 09:53:35 user nova-compute[70374]: </disk>
Jul 27 09:53:35 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG nova.network.neutron [req-0b6f86ad-eec9-420d-9b27-97e2b16507e3 req-9fd72b8d-8d86-48fb-80d5-c487abdcc162 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updated VIF entry in instance network info cache for port 71322434-89a5-4567-bcca-b587128b0149. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG nova.network.neutron [req-0b6f86ad-eec9-420d-9b27-97e2b16507e3 req-9fd72b8d-8d86-48fb-80d5-c487abdcc162 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0b6f86ad-eec9-420d-9b27-97e2b16507e3 req-9fd72b8d-8d86-48fb-80d5-c487abdcc162 service nova] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451616.476964, 567b856e-1a3b-4a12-8ead-d67b2154d18a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:53:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully detached device vdb from instance 567b856e-1a3b-4a12-8ead-d67b2154d18a from the live domain config.
Jul 27 09:53:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeEPbKhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:53:36 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8aa31b-0314-4601-a2c2-0161f4a11c54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:53:36 user nova-compute[70374]: No targets found.
Jul 27 09:53:36 user nova-compute[70374]: iSNS:
Jul 27 09:53:36 user nova-compute[70374]: No targets found.
Jul 27 09:53:36 user nova-compute[70374]: STATIC:
Jul 27 09:53:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63
Jul 27 09:53:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:53:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:53:36 user nova-compute[70374]: FIRMWARE:
Jul 27 09:53:36 user nova-compute[70374]: No targets found.
Jul 27 09:53:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:53:36 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:53:36 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5821ddda-d9a8-41d7-ab77-522c08ffaaae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[83baab57-1451-4081-b1bb-b6bbe5fa2b26]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:53:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 (non-flash)
Jul 27 09:53:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc451900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c81cc94-f1ba-454d-aecc-7a6799c7d951]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d556911-64cc-42e9-9ef1-f3e2acf54eaf]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe43a53b-20c9-473d-a540-51b4fb08d0c6]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8314fa60-4c62-4560-b090-65364054b0ea]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[770a1544-388b-4bbe-b7e1-b8552e2b13ac]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb1132f-0cf6-405c-a68d-944875b2ebf3]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260]
Jul 27 09:53:36 user nova-compute[70374]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63, portal: 172.16.0.220,3260] successful.
Jul 27 09:53:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db058caf-412f-4b53-b884-93aa8a161d63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e98a04-8082-43fb-9446-4c07fe066893]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] <== disconnect_volume: return (301ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:53:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:53:37 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'flavor' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:53:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ac2de3d4-2542-4333-8cb8-560071ac5c84 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:53:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:53:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:53:48 user nova-compute[70374]: INFO nova.compute.manager [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] instance snapshotting
Jul 27 09:53:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Beginning live snapshot process
Jul 27 09:53:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json -f qcow2 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json -f qcow2 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzh3317z9/a8541ee54b4146c2ba5b2315c6f1c9a1.delta 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzh3317z9/a8541ee54b4146c2ba5b2315c6f1c9a1.delta 1073741824" returned: 0 in 0.068s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:49 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 09:53:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:53:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 09:53:50 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 09:53:50 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:53:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzh3317z9/a8541ee54b4146c2ba5b2315c6f1c9a1.delta /opt/stack/data/nova/instances/snapshots/tmpzh3317z9/a8541ee54b4146c2ba5b2315c6f1c9a1 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:53:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzh3317z9/a8541ee54b4146c2ba5b2315c6f1c9a1.delta /opt/stack/data/nova/instances/snapshots/tmpzh3317z9/a8541ee54b4146c2ba5b2315c6f1c9a1" returned: 0 in 0.467s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:53:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Snapshot extracted, beginning image upload
Jul 27 09:53:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:53:53 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Snapshot image upload complete
Jul 27 09:53:53 user nova-compute[70374]: INFO nova.compute.manager [None req-708fce61-419d-440b-aaf9-2b04de8186a7 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Took 4.88 seconds to snapshot the instance on the hypervisor.
Jul 27 09:53:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:11 user nova-compute[70374]: INFO nova.compute.manager [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Terminating instance
Jul 27 09:54:11 user nova-compute[70374]: DEBUG nova.compute.manager [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-98d5b6b7-46ec-4f29-bd55-df9b29b3ac75 req-54101170-8519-480f-b4eb-8790046d8190 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-unplugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-98d5b6b7-46ec-4f29-bd55-df9b29b3ac75 req-54101170-8519-480f-b4eb-8790046d8190 service nova] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-98d5b6b7-46ec-4f29-bd55-df9b29b3ac75 req-54101170-8519-480f-b4eb-8790046d8190 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-98d5b6b7-46ec-4f29-bd55-df9b29b3ac75 req-54101170-8519-480f-b4eb-8790046d8190 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-98d5b6b7-46ec-4f29-bd55-df9b29b3ac75 req-54101170-8519-480f-b4eb-8790046d8190 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] No waiting events found dispatching network-vif-unplugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:54:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-98d5b6b7-46ec-4f29-bd55-df9b29b3ac75 req-54101170-8519-480f-b4eb-8790046d8190 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-unplugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:54:12 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Instance destroyed successfully.
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lazy-loading 'resources' on Instance uuid 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-423924851',display_name='tempest-ServerActionsTestOtherA-server-1522874168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-423924851',id=23,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcS6ZgJzFRn+Cuko+BlX9cZA/b1lPV7MVYasLp/l2fGf3DaFrr3RJdl1CmljafHHPMY/tZyjw07v0QPFMeG8aEmnBwaXphu5081Fjx7t9Uf4aH8U7MvZtPmgJydrjCUDQ==',key_name='tempest-keypair-1611102482',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:42:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f06bd4d4e7144fbc99c907fb405b7e99',ramdisk_id='',reservation_id='r-25r1p5d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2053926798',owner_user_name='tempest-ServerActionsTestOtherA-2053926798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2b416973f744369818b2a67bcecdeb9',uuid=206f2727-3adb-4f39-b1d6-4ec1352e8cf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converting VIF {"id": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "address": "fa:16:3e:8f:9b:7f", "network": {"id": "12d6bc1e-13aa-4686-87fb-86c5dc1c3d23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1385823171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06bd4d4e7144fbc99c907fb405b7e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e54f01f-07", "ovs_interfaceid": "5e54f01f-0732-4e78-bcc1-f9e45af08a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG os_vif [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e54f01f-07, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:12 user nova-compute[70374]: INFO os_vif [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a,network=Network(12d6bc1e-13aa-4686-87fb-86c5dc1c3d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e54f01f-07')
Jul 27 09:54:12 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Deleting instance files /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8_del
Jul 27 09:54:12 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Deletion of /opt/stack/data/nova/instances/206f2727-3adb-4f39-b1d6-4ec1352e8cf8_del complete
Jul 27 09:54:12 user nova-compute[70374]: INFO nova.compute.manager [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 09:54:12 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:54:12 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Took 0.50 seconds to deallocate network for instance.
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-b7f2c1f9-745b-42b3-8666-261b7c88bf34 req-2f78816e-2df1-48c5-b9cf-c485fa6de4c5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-deleted-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:12 user nova-compute[70374]: INFO nova.compute.manager [req-b7f2c1f9-745b-42b3-8666-261b7c88bf34 req-2f78816e-2df1-48c5-b9cf-c485fa6de4c5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Neutron deleted interface 5e54f01f-0732-4e78-bcc1-f9e45af08a0a; detaching it from the instance and deleting it from the info cache
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-b7f2c1f9-745b-42b3-8666-261b7c88bf34 req-2f78816e-2df1-48c5-b9cf-c485fa6de4c5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-b7f2c1f9-745b-42b3-8666-261b7c88bf34 req-2f78816e-2df1-48c5-b9cf-c485fa6de4c5 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Detach interface failed, port_id=5e54f01f-0732-4e78-bcc1-f9e45af08a0a, reason: Instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:13 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:54:13 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:54:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:13 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Deleted allocations for instance 206f2727-3adb-4f39-b1d6-4ec1352e8cf8
Jul 27 09:54:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-97a2c3b8-5a48-4af7-afd9-0dfc18384963 tempest-ServerActionsTestOtherA-2053926798 tempest-ServerActionsTestOtherA-2053926798-project-member] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.810s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-5111b9b9-4964-4b1a-8836-4857f7f388ae req-9df446c2-bf3e-40c6-9945-f5d0f5edf7b2 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5111b9b9-4964-4b1a-8836-4857f7f388ae req-9df446c2-bf3e-40c6-9945-f5d0f5edf7b2 service nova] Acquiring lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5111b9b9-4964-4b1a-8836-4857f7f388ae req-9df446c2-bf3e-40c6-9945-f5d0f5edf7b2 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5111b9b9-4964-4b1a-8836-4857f7f388ae req-9df446c2-bf3e-40c6-9945-f5d0f5edf7b2 service nova] Lock "206f2727-3adb-4f39-b1d6-4ec1352e8cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-5111b9b9-4964-4b1a-8836-4857f7f388ae req-9df446c2-bf3e-40c6-9945-f5d0f5edf7b2 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] No waiting events found dispatching network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:54:13 user nova-compute[70374]: WARNING nova.compute.manager [req-5111b9b9-4964-4b1a-8836-4857f7f388ae req-9df446c2-bf3e-40c6-9945-f5d0f5edf7b2 service nova] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Received unexpected event network-vif-plugged-5e54f01f-0732-4e78-bcc1-f9e45af08a0a for instance with vm_state deleted and task_state None.
Jul 27 09:54:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:21 user nova-compute[70374]: INFO nova.compute.manager [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Terminating instance
Jul 27 09:54:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-2ffc0f62-ecb7-491d-9820-0f3ff412dd80 req-a35b706b-bb6c-402a-b63e-c83142eca70e service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-unplugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2ffc0f62-ecb7-491d-9820-0f3ff412dd80 req-a35b706b-bb6c-402a-b63e-c83142eca70e service nova] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2ffc0f62-ecb7-491d-9820-0f3ff412dd80 req-a35b706b-bb6c-402a-b63e-c83142eca70e service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2ffc0f62-ecb7-491d-9820-0f3ff412dd80 req-a35b706b-bb6c-402a-b63e-c83142eca70e service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-2ffc0f62-ecb7-491d-9820-0f3ff412dd80 req-a35b706b-bb6c-402a-b63e-c83142eca70e service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] No waiting events found dispatching network-vif-unplugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:54:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-2ffc0f62-ecb7-491d-9820-0f3ff412dd80 req-a35b706b-bb6c-402a-b63e-c83142eca70e service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-unplugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:54:22 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Instance destroyed successfully.
Jul 27 09:54:22 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lazy-loading 'resources' on Instance uuid 4ece765d-2273-40d7-bb46-39d87fd0c819 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T09:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-224474522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-224474522',id=35,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuV0qR/Ed0QIyRTfenNYTPSi1Xqznmf0lvxujvI1zqxuAvV4Lc0TIHQ/hKJ78U0OyU4woeLxnFhFf7LAGGX+doBW5PBY0NGNgTMGCx3E/qhixWZxAY4sc74cz3302cKoA==',key_name='tempest-keypair-1842228732',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:52:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d32e43d96bc4f0a99fd3378c1677fb7',ramdisk_id='',reservation_id='r-4dravgqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1605888290',owner_user_name='tempest-AttachVolumeShelveTestJSON-1605888290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='377915ad2c6e4244b5bd1a7ed97c6afb',uuid=4ece765d-2273-40d7-bb46-39d87fd0c819,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converting VIF {"id": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "address": "fa:16:3e:95:c9:e3", "network": {"id": "44426ef8-70ed-447f-ad7a-a15d0caf5708", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1871646968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d32e43d96bc4f0a99fd3378c1677fb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbef25bb2-a1", "ovs_interfaceid": "bef25bb2-a169-4d36-b13f-ac8fd72b5d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG os_vif [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbef25bb2-a1, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:54:22 user nova-compute[70374]: INFO os_vif [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=bef25bb2-a169-4d36-b13f-ac8fd72b5d2c,network=Network(44426ef8-70ed-447f-ad7a-a15d0caf5708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbef25bb2-a1')
Jul 27 09:54:22 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Deleting instance files /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819_del
Jul 27 09:54:22 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Deletion of /opt/stack/data/nova/instances/4ece765d-2273-40d7-bb46-39d87fd0c819_del complete
Jul 27 09:54:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:22 user nova-compute[70374]: INFO nova.compute.manager [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Took 0.68 seconds to destroy the instance on the hypervisor.
Jul 27 09:54:22 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:54:23 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Took 0.99 seconds to deallocate network for instance.
Jul 27 09:54:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-df4baf5b-b49c-4b30-ad02-aba282ef7af9 req-46a775fe-14a3-4961-b767-b90de03b8ff0 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-deleted-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:23 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Deleted allocations for instance 4ece765d-2273-40d7-bb46-39d87fd0c819
Jul 27 09:54:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8d320ecf-2a36-4498-a4cd-69e7db3f9939 tempest-AttachVolumeShelveTestJSON-1605888290 tempest-AttachVolumeShelveTestJSON-1605888290-project-member] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-99a39a94-a2cb-4409-92fb-a48d81f2bd2e req-197a0d62-87ee-4722-8107-c445e2cde025 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-99a39a94-a2cb-4409-92fb-a48d81f2bd2e req-197a0d62-87ee-4722-8107-c445e2cde025 service nova] Acquiring lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-99a39a94-a2cb-4409-92fb-a48d81f2bd2e req-197a0d62-87ee-4722-8107-c445e2cde025 service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-99a39a94-a2cb-4409-92fb-a48d81f2bd2e req-197a0d62-87ee-4722-8107-c445e2cde025 service nova] Lock "4ece765d-2273-40d7-bb46-39d87fd0c819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-99a39a94-a2cb-4409-92fb-a48d81f2bd2e req-197a0d62-87ee-4722-8107-c445e2cde025 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] No waiting events found dispatching network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:54:23 user nova-compute[70374]: WARNING nova.compute.manager [req-99a39a94-a2cb-4409-92fb-a48d81f2bd2e req-197a0d62-87ee-4722-8107-c445e2cde025 service nova] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Received unexpected event network-vif-plugged-bef25bb2-a169-4d36-b13f-ac8fd72b5d2c for instance with vm_state deleted and task_state None.
Jul 27 09:54:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [{"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-567b856e-1a3b-4a12-8ead-d67b2154d18a" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:54:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451652.227464, 206f2727-3adb-4f39-b1d6-4ec1352e8cf8 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:54:27 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] VM Stopped (Lifecycle Event)
Jul 27 09:54:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-03512e96-39c8-46e1-bb46-cb3f83fbdb1c None None] [instance: 206f2727-3adb-4f39-b1d6-4ec1352e8cf8] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:54:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:54:28 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:54:28 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:54:28 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=25.32213592529297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 567b856e-1a3b-4a12-8ead-d67b2154d18a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:54:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:31 user nova-compute[70374]: INFO nova.compute.manager [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Terminating instance
Jul 27 09:54:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-15ac4b34-73e4-496f-ab9c-0a36dee25b12 req-684145b2-59af-4eae-8f30-0455d4e0fb5c service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-unplugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-15ac4b34-73e4-496f-ab9c-0a36dee25b12 req-684145b2-59af-4eae-8f30-0455d4e0fb5c service nova] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-15ac4b34-73e4-496f-ab9c-0a36dee25b12 req-684145b2-59af-4eae-8f30-0455d4e0fb5c service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-15ac4b34-73e4-496f-ab9c-0a36dee25b12 req-684145b2-59af-4eae-8f30-0455d4e0fb5c service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-15ac4b34-73e4-496f-ab9c-0a36dee25b12 req-684145b2-59af-4eae-8f30-0455d4e0fb5c service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] No waiting events found dispatching network-vif-unplugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-15ac4b34-73e4-496f-ab9c-0a36dee25b12 req-684145b2-59af-4eae-8f30-0455d4e0fb5c service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-unplugged-71322434-89a5-4567-bcca-b587128b0149 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Instance destroyed successfully.
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'resources' on Instance uuid 567b856e-1a3b-4a12-8ead-d67b2154d18a {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2042600824',display_name='tempest-TestMinimumBasicScenario-server-2042600824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2042600824',id=36,image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE1XN7Mz8irdJ5W8ZbQhTWChaYO4ff7cqi50Szx1yn/v3gWx2SJUQfHT4ZvHDw03qmc0t+d94JKmbOAcpHp88aF7kn3HcBC1m5pwTdaBhJDo8Y6s8TSSpEM7ENG4/6S5g==',key_name='tempest-TestMinimumBasicScenario-1717295520',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:49:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-w6zrh540',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4bd68661-7500-4179-b5df-e32cecaf17a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:51:50Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=567b856e-1a3b-4a12-8ead-d67b2154d18a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "71322434-89a5-4567-bcca-b587128b0149", "address": "fa:16:3e:3c:1f:12", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71322434-89", "ovs_interfaceid": "71322434-89a5-4567-bcca-b587128b0149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG os_vif [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71322434-89, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:54:32 user nova-compute[70374]: INFO os_vif [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1f:12,bridge_name='br-int',has_traffic_filtering=True,id=71322434-89a5-4567-bcca-b587128b0149,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71322434-89')
Jul 27 09:54:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Deleting instance files /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a_del
Jul 27 09:54:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Deletion of /opt/stack/data/nova/instances/567b856e-1a3b-4a12-8ead-d67b2154d18a_del complete
Jul 27 09:54:32 user nova-compute[70374]: INFO nova.compute.manager [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 27 09:54:32 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:54:32 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:54:33 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:54:33 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Took 0.50 seconds to deallocate network for instance.
Jul 27 09:54:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:33 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:54:33 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:54:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:33 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Deleted allocations for instance 567b856e-1a3b-4a12-8ead-d67b2154d18a
Jul 27 09:54:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8202cfce-e338-4677-9c10-7fbcb5a9f1c4 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.753s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-887da143-251b-4a5f-ada0-1d6f594b2348 req-2990c510-8ac8-4bfa-8b87-bfda399bda43 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-887da143-251b-4a5f-ada0-1d6f594b2348 req-2990c510-8ac8-4bfa-8b87-bfda399bda43 service nova] Acquiring lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-887da143-251b-4a5f-ada0-1d6f594b2348 req-2990c510-8ac8-4bfa-8b87-bfda399bda43 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-887da143-251b-4a5f-ada0-1d6f594b2348 req-2990c510-8ac8-4bfa-8b87-bfda399bda43 service nova] Lock "567b856e-1a3b-4a12-8ead-d67b2154d18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-887da143-251b-4a5f-ada0-1d6f594b2348 req-2990c510-8ac8-4bfa-8b87-bfda399bda43 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] No waiting events found dispatching network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:54:34 user nova-compute[70374]: WARNING nova.compute.manager [req-887da143-251b-4a5f-ada0-1d6f594b2348 req-2990c510-8ac8-4bfa-8b87-bfda399bda43 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received unexpected event network-vif-plugged-71322434-89a5-4567-bcca-b587128b0149 for instance with vm_state deleted and task_state None.
Jul 27 09:54:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-887da143-251b-4a5f-ada0-1d6f594b2348 req-2990c510-8ac8-4bfa-8b87-bfda399bda43 service nova] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Received event network-vif-deleted-71322434-89a5-4567-bcca-b587128b0149 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:37 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451662.030472, 4ece765d-2273-40d7-bb46-39d87fd0c819 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:54:37 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] VM Stopped (Lifecycle Event)
Jul 27 09:54:37 user nova-compute[70374]: DEBUG nova.compute.manager [None req-beee46f6-f531-4e90-8dbe-f6b2725a0f12 None None] [instance: 4ece765d-2273-40d7-bb46-39d87fd0c819] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:54:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:54:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:54:47 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451672.5202427, 567b856e-1a3b-4a12-8ead-d67b2154d18a => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:54:47 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] VM Stopped (Lifecycle Event)
Jul 27 09:54:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-359fabad-bc89-4a92-98ef-743759687115 None None] [instance: 567b856e-1a3b-4a12-8ead-d67b2154d18a] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:54:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:54:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:54:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:54:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:54:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:54:55 user nova-compute[70374]: INFO nova.compute.claims [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Claim successful on node user
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:54:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:54:55 user nova-compute[70374]: INFO nova.virt.block_device [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Booting with blank volume at /dev/vda
Jul 27 09:54:55 user nova-compute[70374]: DEBUG nova.policy [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '653bb45e82be4371b55519bbf5308711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15442b359a014219b7854237eaaad0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:54:56 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Successfully created port: 0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Successfully updated port: 0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquired lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-aac6787f-4981-4de5-8fdc-560d8285f36b req-85d7f5d7-84e5-4657-ab3d-1f4150ebd0b7 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-changed-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG nova.compute.manager [req-aac6787f-4981-4de5-8fdc-560d8285f36b req-85d7f5d7-84e5-4657-ab3d-1f4150ebd0b7 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Refreshing instance network info cache due to event network-changed-0de024ba-70c5-4ed4-b007-aaa78b431855. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aac6787f-4981-4de5-8fdc-560d8285f36b req-85d7f5d7-84e5-4657-ab3d-1f4150ebd0b7 service nova] Acquiring lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Releasing lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance network_info: |[{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aac6787f-4981-4de5-8fdc-560d8285f36b req-85d7f5d7-84e5-4657-ab3d-1f4150ebd0b7 service nova] Acquired lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG nova.network.neutron [req-aac6787f-4981-4de5-8fdc-560d8285f36b req-85d7f5d7-84e5-4657-ab3d-1f4150ebd0b7 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Refreshing network info cache for port 0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:54:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:54:58 user nova-compute[70374]: DEBUG nova.network.neutron [req-aac6787f-4981-4de5-8fdc-560d8285f36b req-85d7f5d7-84e5-4657-ab3d-1f4150ebd0b7 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updated VIF entry in instance network info cache for port 0de024ba-70c5-4ed4-b007-aaa78b431855. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:54:58 user nova-compute[70374]: DEBUG nova.network.neutron [req-aac6787f-4981-4de5-8fdc-560d8285f36b req-85d7f5d7-84e5-4657-ab3d-1f4150ebd0b7 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:54:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-aac6787f-4981-4de5-8fdc-560d8285f36b req-85d7f5d7-84e5-4657-ab3d-1f4150ebd0b7 service nova] Releasing lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG os_brick.utils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db2304-2431-4eaa-971d-35864f0350e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0b0da5-20a8-44a7-a77a-b0847262fe4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb0f1ac-2a12-4f48-93e6-da26600e8c68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db9e9e5-1aaf-4c7f-b9c1-6be568e0584a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:55:01 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:55:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb93ba1-184a-45d8-b9d4-74fcc9ba1457]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG os_brick.utils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:55:01 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating existing volume attachment record: de3f0f8a-14a4-4a12-95e7-435921c1efb8 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:55:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:55:07 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Creating image(s)
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Ensure instance console log exists: /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Start _get_guest_xml network_info=[{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'de3f0f8a-14a4-4a12-95e7-435921c1efb8', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTeVNkLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15c7721e-cebc-4f3a-a214-ea93ef21a80d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2eac07e-e7d4-4262-b19d-239eae23984d', 'serial': 'c2eac07e-e7d4-4262-b19d-239eae23984d'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:55:07 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:55:07 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTeVNkLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:55:07 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:55:07 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:55:07 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6df604-b093-4b47-8a4c-1842fbe2401c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:55:07 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e51773-d1db-4540-970c-ca2ad70409e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d] added
Jul 27 09:55:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bcaf73-fbf7-438e-a992-9b1d17eefa81]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fd3f6b-c004-42db-a8c4-f924b6cd6def]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTeVNkLR {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTeVNkLR" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80e09e2-5370-4539-ae34-628779b24913]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sTeVNkLR'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0839c-4463-4202-aca0-7e7b8b6bae79]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d048e0a-d51f-48db-b054-e456e9d25b7a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:55:07 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:55:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 09:55:07 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:55:07 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 09:55:07 user nova-compute[70374]: 
Jul 27 09:55:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd976e-095d-41b8-90e4-6a080c7e8c15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d, portal: 172.16.0.220,3260]
Jul 27 09:55:08 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d, portal: 172.16.0.220,3260] successful.
Jul 27 09:55:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe63a0e-f9f7-47cc-aa2e-72929f0b6f12]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ae3ce-bb38-4126-beed-c2c9e841599b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:55:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:55:08 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f990b91-4143-43ec-aeb4-f3986d6db3c2]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:55:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTeVNkLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23964396137323939', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964396137323939', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1910797450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1910797450',id=38,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-62bd6028',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:54:56Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=15c7721e-cebc-4f3a-a214-ea93ef21a80d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:64,bridge_name='br-int',has_traffic_filtering=True,id=0de024ba-70c5-4ed4-b007-aaa78b431855,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de024ba-70') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'pci_devices' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:55:09 user nova-compute[70374]:   <uuid>15c7721e-cebc-4f3a-a214-ea93ef21a80d</uuid>
Jul 27 09:55:09 user nova-compute[70374]:   <name>instance-00000026</name>
Jul 27 09:55:09 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:55:09 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:55:09 user nova-compute[70374]:   <metadata>
Jul 27 09:55:09 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:55:09 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:55:09 user nova-compute[70374]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1910797450</nova:name>
Jul 27 09:55:09 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:55:07</nova:creationTime>
Jul 27 09:55:09 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:55:09 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:55:09 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:55:09 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:55:09 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:55:09 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:55:09 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:55:09 user nova-compute[70374]:       <nova:owner>
Jul 27 09:55:09 user nova-compute[70374]:         <nova:user uuid="653bb45e82be4371b55519bbf5308711">tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member</nova:user>
Jul 27 09:55:09 user nova-compute[70374]:         <nova:project uuid="15442b359a014219b7854237eaaad0d3">tempest-ServerBootFromVolumeStableRescueTest-1815884142</nova:project>
Jul 27 09:55:09 user nova-compute[70374]:       </nova:owner>
Jul 27 09:55:09 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:55:09 user nova-compute[70374]:       <nova:ports>
Jul 27 09:55:09 user nova-compute[70374]:         <nova:port uuid="0de024ba-70c5-4ed4-b007-aaa78b431855">
Jul 27 09:55:09 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 09:55:09 user nova-compute[70374]:         </nova:port>
Jul 27 09:55:09 user nova-compute[70374]:       </nova:ports>
Jul 27 09:55:09 user nova-compute[70374]:     </nova:instance>
Jul 27 09:55:09 user nova-compute[70374]:   </metadata>
Jul 27 09:55:09 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:55:09 user nova-compute[70374]:     <system>
Jul 27 09:55:09 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:55:09 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:55:09 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:55:09 user nova-compute[70374]:       <entry name="serial">15c7721e-cebc-4f3a-a214-ea93ef21a80d</entry>
Jul 27 09:55:09 user nova-compute[70374]:       <entry name="uuid">15c7721e-cebc-4f3a-a214-ea93ef21a80d</entry>
Jul 27 09:55:09 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:55:09 user nova-compute[70374]:     </system>
Jul 27 09:55:09 user nova-compute[70374]:   </sysinfo>
Jul 27 09:55:09 user nova-compute[70374]:   <os>
Jul 27 09:55:09 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:55:09 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:55:09 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:55:09 user nova-compute[70374]:   </os>
Jul 27 09:55:09 user nova-compute[70374]:   <features>
Jul 27 09:55:09 user nova-compute[70374]:     <acpi/>
Jul 27 09:55:09 user nova-compute[70374]:     <apic/>
Jul 27 09:55:09 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:55:09 user nova-compute[70374]:   </features>
Jul 27 09:55:09 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:55:09 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:55:09 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:55:09 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:55:09 user nova-compute[70374]:   </clock>
Jul 27 09:55:09 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:55:09 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:55:09 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:55:09 user nova-compute[70374]:   </cpu>
Jul 27 09:55:09 user nova-compute[70374]:   <devices>
Jul 27 09:55:09 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:55:09 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:55:09 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 09:55:09 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:55:09 user nova-compute[70374]:       <serial>c2eac07e-e7d4-4262-b19d-239eae23984d</serial>
Jul 27 09:55:09 user nova-compute[70374]:     </disk>
Jul 27 09:55:09 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:55:09 user nova-compute[70374]:       <mac address="fa:16:3e:b3:c1:64"/>
Jul 27 09:55:09 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:55:09 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:55:09 user nova-compute[70374]:       <target dev="tap0de024ba-70"/>
Jul 27 09:55:09 user nova-compute[70374]:     </interface>
Jul 27 09:55:09 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:55:09 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/console.log" append="off"/>
Jul 27 09:55:09 user nova-compute[70374]:     </serial>
Jul 27 09:55:09 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:55:09 user nova-compute[70374]:     <video>
Jul 27 09:55:09 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:55:09 user nova-compute[70374]:     </video>
Jul 27 09:55:09 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:55:09 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:55:09 user nova-compute[70374]:     </rng>
Jul 27 09:55:09 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:55:09 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:55:09 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:55:09 user nova-compute[70374]:     </memballoon>
Jul 27 09:55:09 user nova-compute[70374]:   </devices>
Jul 27 09:55:09 user nova-compute[70374]: </domain>
Jul 27 09:55:09 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1910797450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1910797450',id=38,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-62bd6028',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:54:56Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=15c7721e-cebc-4f3a-a214-ea93ef21a80d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:64,bridge_name='br-int',has_traffic_filtering=True,id=0de024ba-70c5-4ed4-b007-aaa78b431855,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de024ba-70') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG os_vif [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:64,bridge_name='br-int',has_traffic_filtering=True,id=0de024ba-70c5-4ed4-b007-aaa78b431855,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de024ba-70') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0de024ba-70, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0de024ba-70, col_values=(('external_ids', {'iface-id': '0de024ba-70c5-4ed4-b007-aaa78b431855', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:c1:64', 'vm-uuid': '15c7721e-cebc-4f3a-a214-ea93ef21a80d'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:09 user nova-compute[70374]: INFO os_vif [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:64,bridge_name='br-int',has_traffic_filtering=True,id=0de024ba-70c5-4ed4-b007-aaa78b431855,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de024ba-70')
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:55:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No VIF found with MAC fa:16:3e:b3:c1:64, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-ffc43bd3-3a0a-44b3-901d-3210e5bc74b0 req-13889fb4-5138-46bb-929a-76b3e0ce6056 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ffc43bd3-3a0a-44b3-901d-3210e5bc74b0 req-13889fb4-5138-46bb-929a-76b3e0ce6056 service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ffc43bd3-3a0a-44b3-901d-3210e5bc74b0 req-13889fb4-5138-46bb-929a-76b3e0ce6056 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ffc43bd3-3a0a-44b3-901d-3210e5bc74b0 req-13889fb4-5138-46bb-929a-76b3e0ce6056 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:10 user nova-compute[70374]: DEBUG nova.compute.manager [req-ffc43bd3-3a0a-44b3-901d-3210e5bc74b0 req-13889fb4-5138-46bb-929a-76b3e0ce6056 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:55:10 user nova-compute[70374]: WARNING nova.compute.manager [req-ffc43bd3-3a0a-44b3-901d-3210e5bc74b0 req-13889fb4-5138-46bb-929a-76b3e0ce6056 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state building and task_state spawning.
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451712.6855388, 15c7721e-cebc-4f3a-a214-ea93ef21a80d => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:55:12 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] VM Resumed (Lifecycle Event)
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:55:12 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance spawned successfully.
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:12 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451712.6873617, 15c7721e-cebc-4f3a-a214-ea93ef21a80d => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:55:12 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] VM Started (Lifecycle Event)
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:55:12 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:55:12 user nova-compute[70374]: INFO nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Took 5.05 seconds to spawn the instance on the hypervisor.
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-bddc361a-7fe7-48db-bd1a-9b2bb15e750e req-fc66f77a-0567-42c0-859b-c74121abdaa1 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bddc361a-7fe7-48db-bd1a-9b2bb15e750e req-fc66f77a-0567-42c0-859b-c74121abdaa1 service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bddc361a-7fe7-48db-bd1a-9b2bb15e750e req-fc66f77a-0567-42c0-859b-c74121abdaa1 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bddc361a-7fe7-48db-bd1a-9b2bb15e750e req-fc66f77a-0567-42c0-859b-c74121abdaa1 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-bddc361a-7fe7-48db-bd1a-9b2bb15e750e req-fc66f77a-0567-42c0-859b-c74121abdaa1 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:55:12 user nova-compute[70374]: WARNING nova.compute.manager [req-bddc361a-7fe7-48db-bd1a-9b2bb15e750e req-fc66f77a-0567-42c0-859b-c74121abdaa1 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state building and task_state spawning.
Jul 27 09:55:12 user nova-compute[70374]: INFO nova.compute.manager [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Took 17.71 seconds to build instance.
Jul 27 09:55:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a1b508fb-601a-4b0f-a1a8-6633cd5180d6 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.801s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:23 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:55:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:25 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:55:25 user nova-compute[70374]: INFO nova.compute.claims [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Claim successful on node user
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:55:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:55:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Creating image(s)
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "/opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "/opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "/opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "774573cc70d44bf40d3c036098d0fb123c0e454c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "774573cc70d44bf40d3c036098d0fb123c0e454c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG nova.policy [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '229f3686d8184688b3ced860a5d7b07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51f550eb3b4bd8883b2242eb2905f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:55:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c.part --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG nova.virt.images [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] 628d0979-639d-4c79-9595-e49dfadbae4a was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c.part /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c.part /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c.converted" returned: 0 in 0.679s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Successfully created port: f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "774573cc70d44bf40d3c036098d0fb123c0e454c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.463s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "774573cc70d44bf40d3c036098d0fb123c0e454c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "774573cc70d44bf40d3c036098d0fb123c0e454c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c --force-share --output=json" returned: 0 in 0.166s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c,backing_fmt=raw /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c,backing_fmt=raw /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk 1073741824" returned: 0 in 0.056s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "774573cc70d44bf40d3c036098d0fb123c0e454c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Cannot resize image /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.objects.instance [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'migration_context' on Instance uuid 708ed7e2-30d9-4a3f-85c8-55e74d98f233 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Ensure instance console log exists: /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.network.neutron [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Successfully updated port: f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquired lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.network.neutron [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-849972f7-c506-436c-9ab4-3127dfe7a1c6 req-22f880ba-c7f1-4843-ad60-4c782b43b435 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-849972f7-c506-436c-9ab4-3127dfe7a1c6 req-22f880ba-c7f1-4843-ad60-4c782b43b435 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing instance network info cache due to event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-849972f7-c506-436c-9ab4-3127dfe7a1c6 req-22f880ba-c7f1-4843-ad60-4c782b43b435 service nova] Acquiring lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:55:28 user nova-compute[70374]: DEBUG nova.network.neutron [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.network.neutron [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Releasing lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Instance network_info: |[{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-849972f7-c506-436c-9ab4-3127dfe7a1c6 req-22f880ba-c7f1-4843-ad60-4c782b43b435 service nova] Acquired lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.network.neutron [req-849972f7-c506-436c-9ab4-3127dfe7a1c6 req-22f880ba-c7f1-4843-ad60-4c782b43b435 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Start _get_guest_xml network_info=[{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:55:23Z,direct_url=<?>,disk_format='qcow2',id=628d0979-639d-4c79-9595-e49dfadbae4a,min_disk=0,min_ram=0,name='tempest-scenario-img--647915121',owner='ec51f550eb3b4bd8883b2242eb2905f7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '628d0979-639d-4c79-9595-e49dfadbae4a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:55:29 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:55:29 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:55:23Z,direct_url=<?>,disk_format='qcow2',id=628d0979-639d-4c79-9595-e49dfadbae4a,min_disk=0,min_ram=0,name='tempest-scenario-img--647915121',owner='ec51f550eb3b4bd8883b2242eb2905f7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1885489661',display_name='tempest-TestMinimumBasicScenario-server-1885489661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1885489661',id=39,image_ref='628d0979-639d-4c79-9595-e49dfadbae4a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzhVyGBZNYtgons3fvGQKB7nVm5zbm6PM105hOB4uC3OrY3ps/Hqs9avyTkdVT3/z0PX00DmMc3YDwmaCMERlG+23gBUEgTeJfwgCrVzQu0EWKp2upfTIFekkeZZRAU3g==',key_name='tempest-TestMinimumBasicScenario-1260725173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-xfqqzprr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='628d0979-639d-4c79-9595-e49dfadbae4a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:55:26Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=708ed7e2-30d9-4a3f-85c8-55e74d98f233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:4f:51,bridge_name='br-int',has_traffic_filtering=True,id=f39e8958-b93d-4b15-8356-edb95877df4c,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39e8958-b9') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.objects.instance [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'pci_devices' on Instance uuid 708ed7e2-30d9-4a3f-85c8-55e74d98f233 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:55:29 user nova-compute[70374]:   <uuid>708ed7e2-30d9-4a3f-85c8-55e74d98f233</uuid>
Jul 27 09:55:29 user nova-compute[70374]:   <name>instance-00000027</name>
Jul 27 09:55:29 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:55:29 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:55:29 user nova-compute[70374]:   <metadata>
Jul 27 09:55:29 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:55:29 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:55:29 user nova-compute[70374]:       <nova:name>tempest-TestMinimumBasicScenario-server-1885489661</nova:name>
Jul 27 09:55:29 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:55:29</nova:creationTime>
Jul 27 09:55:29 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:55:29 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:55:29 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:55:29 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:55:29 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:55:29 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:55:29 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:55:29 user nova-compute[70374]:       <nova:owner>
Jul 27 09:55:29 user nova-compute[70374]:         <nova:user uuid="229f3686d8184688b3ced860a5d7b07e">tempest-TestMinimumBasicScenario-1439165130-project-member</nova:user>
Jul 27 09:55:29 user nova-compute[70374]:         <nova:project uuid="ec51f550eb3b4bd8883b2242eb2905f7">tempest-TestMinimumBasicScenario-1439165130</nova:project>
Jul 27 09:55:29 user nova-compute[70374]:       </nova:owner>
Jul 27 09:55:29 user nova-compute[70374]:       <nova:root type="image" uuid="628d0979-639d-4c79-9595-e49dfadbae4a"/>
Jul 27 09:55:29 user nova-compute[70374]:       <nova:ports>
Jul 27 09:55:29 user nova-compute[70374]:         <nova:port uuid="f39e8958-b93d-4b15-8356-edb95877df4c">
Jul 27 09:55:29 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 09:55:29 user nova-compute[70374]:         </nova:port>
Jul 27 09:55:29 user nova-compute[70374]:       </nova:ports>
Jul 27 09:55:29 user nova-compute[70374]:     </nova:instance>
Jul 27 09:55:29 user nova-compute[70374]:   </metadata>
Jul 27 09:55:29 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:55:29 user nova-compute[70374]:     <system>
Jul 27 09:55:29 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:55:29 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:55:29 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:55:29 user nova-compute[70374]:       <entry name="serial">708ed7e2-30d9-4a3f-85c8-55e74d98f233</entry>
Jul 27 09:55:29 user nova-compute[70374]:       <entry name="uuid">708ed7e2-30d9-4a3f-85c8-55e74d98f233</entry>
Jul 27 09:55:29 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:55:29 user nova-compute[70374]:     </system>
Jul 27 09:55:29 user nova-compute[70374]:   </sysinfo>
Jul 27 09:55:29 user nova-compute[70374]:   <os>
Jul 27 09:55:29 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:55:29 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:55:29 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:55:29 user nova-compute[70374]:   </os>
Jul 27 09:55:29 user nova-compute[70374]:   <features>
Jul 27 09:55:29 user nova-compute[70374]:     <acpi/>
Jul 27 09:55:29 user nova-compute[70374]:     <apic/>
Jul 27 09:55:29 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:55:29 user nova-compute[70374]:   </features>
Jul 27 09:55:29 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:55:29 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:55:29 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:55:29 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:55:29 user nova-compute[70374]:   </clock>
Jul 27 09:55:29 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:55:29 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:55:29 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:55:29 user nova-compute[70374]:   </cpu>
Jul 27 09:55:29 user nova-compute[70374]:   <devices>
Jul 27 09:55:29 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:55:29 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:55:29 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk"/>
Jul 27 09:55:29 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:55:29 user nova-compute[70374]:     </disk>
Jul 27 09:55:29 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:55:29 user nova-compute[70374]:       <mac address="fa:16:3e:43:4f:51"/>
Jul 27 09:55:29 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:55:29 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:55:29 user nova-compute[70374]:       <target dev="tapf39e8958-b9"/>
Jul 27 09:55:29 user nova-compute[70374]:     </interface>
Jul 27 09:55:29 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:55:29 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/console.log" append="off"/>
Jul 27 09:55:29 user nova-compute[70374]:     </serial>
Jul 27 09:55:29 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:55:29 user nova-compute[70374]:     <video>
Jul 27 09:55:29 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:55:29 user nova-compute[70374]:     </video>
Jul 27 09:55:29 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:55:29 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:55:29 user nova-compute[70374]:     </rng>
Jul 27 09:55:29 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:55:29 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:55:29 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:55:29 user nova-compute[70374]:     </memballoon>
Jul 27 09:55:29 user nova-compute[70374]:   </devices>
Jul 27 09:55:29 user nova-compute[70374]: </domain>
Jul 27 09:55:29 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1885489661',display_name='tempest-TestMinimumBasicScenario-server-1885489661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1885489661',id=39,image_ref='628d0979-639d-4c79-9595-e49dfadbae4a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzhVyGBZNYtgons3fvGQKB7nVm5zbm6PM105hOB4uC3OrY3ps/Hqs9avyTkdVT3/z0PX00DmMc3YDwmaCMERlG+23gBUEgTeJfwgCrVzQu0EWKp2upfTIFekkeZZRAU3g==',key_name='tempest-TestMinimumBasicScenario-1260725173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-xfqqzprr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='628d0979-639d-4c79-9595-e49dfadbae4a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:55:26Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=708ed7e2-30d9-4a3f-85c8-55e74d98f233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:4f:51,bridge_name='br-int',has_traffic_filtering=True,id=f39e8958-b93d-4b15-8356-edb95877df4c,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39e8958-b9') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG os_vif [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:4f:51,bridge_name='br-int',has_traffic_filtering=True,id=f39e8958-b93d-4b15-8356-edb95877df4c,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39e8958-b9') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf39e8958-b9, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf39e8958-b9, col_values=(('external_ids', {'iface-id': 'f39e8958-b93d-4b15-8356-edb95877df4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:4f:51', 'vm-uuid': '708ed7e2-30d9-4a3f-85c8-55e74d98f233'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:29 user nova-compute[70374]: INFO os_vif [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:4f:51,bridge_name='br-int',has_traffic_filtering=True,id=f39e8958-b93d-4b15-8356-edb95877df4c,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39e8958-b9')
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No VIF found with MAC fa:16:3e:43:4f:51, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.network.neutron [req-849972f7-c506-436c-9ab4-3127dfe7a1c6 req-22f880ba-c7f1-4843-ad60-4c782b43b435 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updated VIF entry in instance network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG nova.network.neutron [req-849972f7-c506-436c-9ab4-3127dfe7a1c6 req-22f880ba-c7f1-4843-ad60-4c782b43b435 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:55:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-849972f7-c506-436c-9ab4-3127dfe7a1c6 req-22f880ba-c7f1-4843-ad60-4c782b43b435 service nova] Releasing lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:55:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-79bd579d-79d8-4aaf-93f7-4211986bcc27 req-5190cf1d-f253-41d3-a885-e9eb27f39181 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:55:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-79bd579d-79d8-4aaf-93f7-4211986bcc27 req-5190cf1d-f253-41d3-a885-e9eb27f39181 service nova] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-79bd579d-79d8-4aaf-93f7-4211986bcc27 req-5190cf1d-f253-41d3-a885-e9eb27f39181 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-79bd579d-79d8-4aaf-93f7-4211986bcc27 req-5190cf1d-f253-41d3-a885-e9eb27f39181 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-79bd579d-79d8-4aaf-93f7-4211986bcc27 req-5190cf1d-f253-41d3-a885-e9eb27f39181 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] No waiting events found dispatching network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:55:30 user nova-compute[70374]: WARNING nova.compute.manager [req-79bd579d-79d8-4aaf-93f7-4211986bcc27 req-5190cf1d-f253-41d3-a885-e9eb27f39181 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received unexpected event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c for instance with vm_state building and task_state spawning.
Jul 27 09:55:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:55:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:55:32 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:55:32 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.317615509033203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-e85e6286-7b22-438a-9ee4-f0e371e1741a req-af03ecad-468f-4740-8ab9-e74e2ef987f2 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e85e6286-7b22-438a-9ee4-f0e371e1741a req-af03ecad-468f-4740-8ab9-e74e2ef987f2 service nova] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e85e6286-7b22-438a-9ee4-f0e371e1741a req-af03ecad-468f-4740-8ab9-e74e2ef987f2 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e85e6286-7b22-438a-9ee4-f0e371e1741a req-af03ecad-468f-4740-8ab9-e74e2ef987f2 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-e85e6286-7b22-438a-9ee4-f0e371e1741a req-af03ecad-468f-4740-8ab9-e74e2ef987f2 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] No waiting events found dispatching network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:55:32 user nova-compute[70374]: WARNING nova.compute.manager [req-e85e6286-7b22-438a-9ee4-f0e371e1741a req-af03ecad-468f-4740-8ab9-e74e2ef987f2 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received unexpected event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c for instance with vm_state building and task_state spawning.
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451732.9143775, 708ed7e2-30d9-4a3f-85c8-55e74d98f233 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:55:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] VM Resumed (Lifecycle Event)
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:55:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Instance spawned successfully.
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:55:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:55:32 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451732.9191127, 708ed7e2-30d9-4a3f-85c8-55e74d98f233 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:55:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] VM Started (Lifecycle Event)
Jul 27 09:55:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:55:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:55:33 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:55:33 user nova-compute[70374]: INFO nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Took 6.63 seconds to spawn the instance on the hypervisor.
Jul 27 09:55:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:55:33 user nova-compute[70374]: INFO nova.compute.manager [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Took 7.28 seconds to build instance.
Jul 27 09:55:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-abb2ede6-73d5-432c-8493-9d71d5c30d2b tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.395s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:55:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:55:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:55:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:16 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:56:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:16 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:56:16 user nova-compute[70374]: INFO nova.compute.claims [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Claim successful on node user
Jul 27 09:56:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:56:17 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.policy [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0dcf241bc6e46578bae97c3905188d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d61f8c09d9489d9d1a7672f50c8d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:56:17 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Creating image(s)
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "/opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "/opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "/opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk 1073741824" returned: 0 in 0.065s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:17 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.169s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Successfully created port: 7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Cannot resize image /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lazy-loading 'migration_context' on Instance uuid f37b88a5-5935-4a36-8099-f21ebc27767d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Ensure instance console log exists: /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Successfully updated port: 7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquired lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:56:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-868aff8d-e66c-48f2-999a-244cc8b665ea req-d2133544-07df-4ada-bef4-d397a71de977 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received event network-changed-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-868aff8d-e66c-48f2-999a-244cc8b665ea req-d2133544-07df-4ada-bef4-d397a71de977 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Refreshing instance network info cache due to event network-changed-7caf0700-cf05-4bf1-9663-8ef0565f0002. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-868aff8d-e66c-48f2-999a-244cc8b665ea req-d2133544-07df-4ada-bef4-d397a71de977 service nova] Acquiring lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.neutron [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Updating instance_info_cache with network_info: [{"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Releasing lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Instance network_info: |[{"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-868aff8d-e66c-48f2-999a-244cc8b665ea req-d2133544-07df-4ada-bef4-d397a71de977 service nova] Acquired lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.neutron [req-868aff8d-e66c-48f2-999a-244cc8b665ea req-d2133544-07df-4ada-bef4-d397a71de977 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Refreshing network info cache for port 7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Start _get_guest_xml network_info=[{"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:56:19 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:56:19 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210607775',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210607775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210607',id=40,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd5vocl1CW/v62dSHdQ7HFBPZdrSJksTrcO7PiFg+0VHWygx+wcMCmtUQq+qzuE6p8VLbTDk5I5wl8zSjnISWWEpfNULT5MNX2D9f8viv9wzLLCdAEBFbBWg2tGiTVGrw==',key_name='tempest-keypair-1410515328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d61f8c09d9489d9d1a7672f50c8d34',ramdisk_id='',reservation_id='r-mn0h76k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1976831533',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0dcf241bc6e46578bae97c3905188d3',uuid=f37b88a5-5935-4a36-8099-f21ebc27767d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Converting VIF {"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=7caf0700-cf05-4bf1-9663-8ef0565f0002,network=Network(39e3ac5a-7dc7-44b7-8c28-a2658eac7567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7caf0700-cf') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.objects.instance [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lazy-loading 'pci_devices' on Instance uuid f37b88a5-5935-4a36-8099-f21ebc27767d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:56:19 user nova-compute[70374]:   <uuid>f37b88a5-5935-4a36-8099-f21ebc27767d</uuid>
Jul 27 09:56:19 user nova-compute[70374]:   <name>instance-00000028</name>
Jul 27 09:56:19 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:56:19 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:56:19 user nova-compute[70374]:   <metadata>
Jul 27 09:56:19 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:56:19 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:56:19 user nova-compute[70374]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1210607775</nova:name>
Jul 27 09:56:19 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:56:19</nova:creationTime>
Jul 27 09:56:19 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:56:19 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:56:19 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:56:19 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:56:19 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:56:19 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:56:19 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:56:19 user nova-compute[70374]:       <nova:owner>
Jul 27 09:56:19 user nova-compute[70374]:         <nova:user uuid="b0dcf241bc6e46578bae97c3905188d3">tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member</nova:user>
Jul 27 09:56:19 user nova-compute[70374]:         <nova:project uuid="45d61f8c09d9489d9d1a7672f50c8d34">tempest-TestServerVolumeAttachScenarioOldVersion-1976831533</nova:project>
Jul 27 09:56:19 user nova-compute[70374]:       </nova:owner>
Jul 27 09:56:19 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:56:19 user nova-compute[70374]:       <nova:ports>
Jul 27 09:56:19 user nova-compute[70374]:         <nova:port uuid="7caf0700-cf05-4bf1-9663-8ef0565f0002">
Jul 27 09:56:19 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 09:56:19 user nova-compute[70374]:         </nova:port>
Jul 27 09:56:19 user nova-compute[70374]:       </nova:ports>
Jul 27 09:56:19 user nova-compute[70374]:     </nova:instance>
Jul 27 09:56:19 user nova-compute[70374]:   </metadata>
Jul 27 09:56:19 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:56:19 user nova-compute[70374]:     <system>
Jul 27 09:56:19 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:56:19 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:56:19 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:56:19 user nova-compute[70374]:       <entry name="serial">f37b88a5-5935-4a36-8099-f21ebc27767d</entry>
Jul 27 09:56:19 user nova-compute[70374]:       <entry name="uuid">f37b88a5-5935-4a36-8099-f21ebc27767d</entry>
Jul 27 09:56:19 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:56:19 user nova-compute[70374]:     </system>
Jul 27 09:56:19 user nova-compute[70374]:   </sysinfo>
Jul 27 09:56:19 user nova-compute[70374]:   <os>
Jul 27 09:56:19 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:56:19 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:56:19 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:56:19 user nova-compute[70374]:   </os>
Jul 27 09:56:19 user nova-compute[70374]:   <features>
Jul 27 09:56:19 user nova-compute[70374]:     <acpi/>
Jul 27 09:56:19 user nova-compute[70374]:     <apic/>
Jul 27 09:56:19 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:56:19 user nova-compute[70374]:   </features>
Jul 27 09:56:19 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:56:19 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:56:19 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:56:19 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:56:19 user nova-compute[70374]:   </clock>
Jul 27 09:56:19 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:56:19 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:56:19 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:56:19 user nova-compute[70374]:   </cpu>
Jul 27 09:56:19 user nova-compute[70374]:   <devices>
Jul 27 09:56:19 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:56:19 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:56:19 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk"/>
Jul 27 09:56:19 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:56:19 user nova-compute[70374]:     </disk>
Jul 27 09:56:19 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:56:19 user nova-compute[70374]:       <mac address="fa:16:3e:cd:72:a4"/>
Jul 27 09:56:19 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:56:19 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:56:19 user nova-compute[70374]:       <target dev="tap7caf0700-cf"/>
Jul 27 09:56:19 user nova-compute[70374]:     </interface>
Jul 27 09:56:19 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:56:19 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/console.log" append="off"/>
Jul 27 09:56:19 user nova-compute[70374]:     </serial>
Jul 27 09:56:19 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:56:19 user nova-compute[70374]:     <video>
Jul 27 09:56:19 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:56:19 user nova-compute[70374]:     </video>
Jul 27 09:56:19 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:56:19 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:56:19 user nova-compute[70374]:     </rng>
Jul 27 09:56:19 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:56:19 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:56:19 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:56:19 user nova-compute[70374]:     </memballoon>
Jul 27 09:56:19 user nova-compute[70374]:   </devices>
Jul 27 09:56:19 user nova-compute[70374]: </domain>
Jul 27 09:56:19 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210607775',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210607775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210607',id=40,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd5vocl1CW/v62dSHdQ7HFBPZdrSJksTrcO7PiFg+0VHWygx+wcMCmtUQq+qzuE6p8VLbTDk5I5wl8zSjnISWWEpfNULT5MNX2D9f8viv9wzLLCdAEBFbBWg2tGiTVGrw==',key_name='tempest-keypair-1410515328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d61f8c09d9489d9d1a7672f50c8d34',ramdisk_id='',reservation_id='r-mn0h76k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1976831533',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0dcf241bc6e46578bae97c3905188d3',uuid=f37b88a5-5935-4a36-8099-f21ebc27767d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Converting VIF {"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=7caf0700-cf05-4bf1-9663-8ef0565f0002,network=Network(39e3ac5a-7dc7-44b7-8c28-a2658eac7567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7caf0700-cf') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG os_vif [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=7caf0700-cf05-4bf1-9663-8ef0565f0002,network=Network(39e3ac5a-7dc7-44b7-8c28-a2658eac7567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7caf0700-cf') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7caf0700-cf, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7caf0700-cf, col_values=(('external_ids', {'iface-id': '7caf0700-cf05-4bf1-9663-8ef0565f0002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:72:a4', 'vm-uuid': 'f37b88a5-5935-4a36-8099-f21ebc27767d'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:19 user nova-compute[70374]: INFO os_vif [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=7caf0700-cf05-4bf1-9663-8ef0565f0002,network=Network(39e3ac5a-7dc7-44b7-8c28-a2658eac7567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7caf0700-cf')
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] No VIF found with MAC fa:16:3e:cd:72:a4, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.neutron [req-868aff8d-e66c-48f2-999a-244cc8b665ea req-d2133544-07df-4ada-bef4-d397a71de977 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Updated VIF entry in instance network info cache for port 7caf0700-cf05-4bf1-9663-8ef0565f0002. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG nova.network.neutron [req-868aff8d-e66c-48f2-999a-244cc8b665ea req-d2133544-07df-4ada-bef4-d397a71de977 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Updating instance_info_cache with network_info: [{"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:56:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-868aff8d-e66c-48f2-999a-244cc8b665ea req-d2133544-07df-4ada-bef4-d397a71de977 service nova] Releasing lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:56:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 09:56:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 09:56:21 user nova-compute[70374]: INFO nova.compute.claims [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Claim successful on node user
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-4829ff71-2394-4797-b3bb-591bad0e12d4 req-8c4a385a-0819-4c7d-99b3-42c3c15be24e service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received event network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4829ff71-2394-4797-b3bb-591bad0e12d4 req-8c4a385a-0819-4c7d-99b3-42c3c15be24e service nova] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4829ff71-2394-4797-b3bb-591bad0e12d4 req-8c4a385a-0819-4c7d-99b3-42c3c15be24e service nova] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4829ff71-2394-4797-b3bb-591bad0e12d4 req-8c4a385a-0819-4c7d-99b3-42c3c15be24e service nova] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-4829ff71-2394-4797-b3bb-591bad0e12d4 req-8c4a385a-0819-4c7d-99b3-42c3c15be24e service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] No waiting events found dispatching network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:21 user nova-compute[70374]: WARNING nova.compute.manager [req-4829ff71-2394-4797-b3bb-591bad0e12d4 req-8c4a385a-0819-4c7d-99b3-42c3c15be24e service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received unexpected event network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 for instance with vm_state building and task_state spawning.
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 09:56:21 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.policy [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '127637a1ef10420881e9895927665f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638d25a4b11a4ddda2fb7b5775f8f396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 09:56:21 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Creating image(s)
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "/opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "/opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "/opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk 1073741824" returned: 0 in 0.311s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.453s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Successfully created port: 7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Cannot resize image /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG nova.objects.instance [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'migration_context' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Ensure instance console log exists: /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.neutron [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Successfully updated port: 7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquired lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.neutron [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-280f019d-0b54-49b3-a376-e3a2f351c51e req-06308f5e-5790-477a-9612-483d95079d5e service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-changed-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-280f019d-0b54-49b3-a376-e3a2f351c51e req-06308f5e-5790-477a-9612-483d95079d5e service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Refreshing instance network info cache due to event network-changed-7981eb37-eb74-45c4-98cd-42f9303161d0. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-280f019d-0b54-49b3-a376-e3a2f351c51e req-06308f5e-5790-477a-9612-483d95079d5e service nova] Acquiring lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.neutron [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-40f8cb7c-ae54-42ce-bc60-f891495d5f84 req-12fa6677-e7f0-47f2-844c-a61dd686d161 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received event network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-40f8cb7c-ae54-42ce-bc60-f891495d5f84 req-12fa6677-e7f0-47f2-844c-a61dd686d161 service nova] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-40f8cb7c-ae54-42ce-bc60-f891495d5f84 req-12fa6677-e7f0-47f2-844c-a61dd686d161 service nova] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-40f8cb7c-ae54-42ce-bc60-f891495d5f84 req-12fa6677-e7f0-47f2-844c-a61dd686d161 service nova] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-40f8cb7c-ae54-42ce-bc60-f891495d5f84 req-12fa6677-e7f0-47f2-844c-a61dd686d161 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] No waiting events found dispatching network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:23 user nova-compute[70374]: WARNING nova.compute.manager [req-40f8cb7c-ae54-42ce-bc60-f891495d5f84 req-12fa6677-e7f0-47f2-844c-a61dd686d161 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received unexpected event network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 for instance with vm_state building and task_state spawning.
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451783.425248, f37b88a5-5935-4a36-8099-f21ebc27767d => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:56:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] VM Resumed (Lifecycle Event)
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:56:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Instance spawned successfully.
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451783.4290926, f37b88a5-5935-4a36-8099-f21ebc27767d => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:56:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] VM Started (Lifecycle Event)
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:56:23 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.neutron [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updating instance_info_cache with network_info: [{"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:56:23 user nova-compute[70374]: INFO nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Took 6.09 seconds to spawn the instance on the hypervisor.
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Releasing lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Instance network_info: |[{"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-280f019d-0b54-49b3-a376-e3a2f351c51e req-06308f5e-5790-477a-9612-483d95079d5e service nova] Acquired lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.neutron [req-280f019d-0b54-49b3-a376-e3a2f351c51e req-06308f5e-5790-477a-9612-483d95079d5e service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Refreshing network info cache for port 7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Start _get_guest_xml network_info=[{"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:56:23 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:56:23 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-511472426',display_name='tempest-TestServerVolumeAttachmentScenario-server-511472426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-511472426',id=41,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1Ow03Du3uPk9avJfrKojKqoIIF6MhGHlipNV0srogeB/cEh5zYwe5cdeZRz+LA7E3LvF4hfHJpuTgj67k8ex7R4CsHShbuAw/6aw+s65Nc3LsIkhsX4ldpMv/KfJnwVg==',key_name='tempest-keypair-93327628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='638d25a4b11a4ddda2fb7b5775f8f396',ramdisk_id='',reservation_id='r-w2uipsn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1220688142',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1220688142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:56:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='127637a1ef10420881e9895927665f67',uuid=70cea63a-70b3-405e-b654-8ea7f1126412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Converting VIF {"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a9:24,bridge_name='br-int',has_traffic_filtering=True,id=7981eb37-eb74-45c4-98cd-42f9303161d0,network=Network(9baec0c8-d89b-4116-8bd2-d6d829d23505),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7981eb37-eb') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.objects.instance [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'pci_devices' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:23 user nova-compute[70374]: INFO nova.compute.manager [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Took 6.77 seconds to build instance.
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:56:23 user nova-compute[70374]:   <uuid>70cea63a-70b3-405e-b654-8ea7f1126412</uuid>
Jul 27 09:56:23 user nova-compute[70374]:   <name>instance-00000029</name>
Jul 27 09:56:23 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:56:23 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:56:23 user nova-compute[70374]:   <metadata>
Jul 27 09:56:23 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:56:23 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:56:23 user nova-compute[70374]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-511472426</nova:name>
Jul 27 09:56:23 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:56:23</nova:creationTime>
Jul 27 09:56:23 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:56:23 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:56:23 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:56:23 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:56:23 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:56:23 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:56:23 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:56:23 user nova-compute[70374]:       <nova:owner>
Jul 27 09:56:23 user nova-compute[70374]:         <nova:user uuid="127637a1ef10420881e9895927665f67">tempest-TestServerVolumeAttachmentScenario-1220688142-project-member</nova:user>
Jul 27 09:56:23 user nova-compute[70374]:         <nova:project uuid="638d25a4b11a4ddda2fb7b5775f8f396">tempest-TestServerVolumeAttachmentScenario-1220688142</nova:project>
Jul 27 09:56:23 user nova-compute[70374]:       </nova:owner>
Jul 27 09:56:23 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:56:23 user nova-compute[70374]:       <nova:ports>
Jul 27 09:56:23 user nova-compute[70374]:         <nova:port uuid="7981eb37-eb74-45c4-98cd-42f9303161d0">
Jul 27 09:56:23 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 09:56:23 user nova-compute[70374]:         </nova:port>
Jul 27 09:56:23 user nova-compute[70374]:       </nova:ports>
Jul 27 09:56:23 user nova-compute[70374]:     </nova:instance>
Jul 27 09:56:23 user nova-compute[70374]:   </metadata>
Jul 27 09:56:23 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:56:23 user nova-compute[70374]:     <system>
Jul 27 09:56:23 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:56:23 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:56:23 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:56:23 user nova-compute[70374]:       <entry name="serial">70cea63a-70b3-405e-b654-8ea7f1126412</entry>
Jul 27 09:56:23 user nova-compute[70374]:       <entry name="uuid">70cea63a-70b3-405e-b654-8ea7f1126412</entry>
Jul 27 09:56:23 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:56:23 user nova-compute[70374]:     </system>
Jul 27 09:56:23 user nova-compute[70374]:   </sysinfo>
Jul 27 09:56:23 user nova-compute[70374]:   <os>
Jul 27 09:56:23 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:56:23 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 09:56:23 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:56:23 user nova-compute[70374]:   </os>
Jul 27 09:56:23 user nova-compute[70374]:   <features>
Jul 27 09:56:23 user nova-compute[70374]:     <acpi/>
Jul 27 09:56:23 user nova-compute[70374]:     <apic/>
Jul 27 09:56:23 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:56:23 user nova-compute[70374]:   </features>
Jul 27 09:56:23 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:56:23 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:56:23 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:56:23 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:56:23 user nova-compute[70374]:   </clock>
Jul 27 09:56:23 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:56:23 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:56:23 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:56:23 user nova-compute[70374]:   </cpu>
Jul 27 09:56:23 user nova-compute[70374]:   <devices>
Jul 27 09:56:23 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:56:23 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:56:23 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk"/>
Jul 27 09:56:23 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:56:23 user nova-compute[70374]:     </disk>
Jul 27 09:56:23 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:56:23 user nova-compute[70374]:       <mac address="fa:16:3e:34:a9:24"/>
Jul 27 09:56:23 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:56:23 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:56:23 user nova-compute[70374]:       <target dev="tap7981eb37-eb"/>
Jul 27 09:56:23 user nova-compute[70374]:     </interface>
Jul 27 09:56:23 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:56:23 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/console.log" append="off"/>
Jul 27 09:56:23 user nova-compute[70374]:     </serial>
Jul 27 09:56:23 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:56:23 user nova-compute[70374]:     <video>
Jul 27 09:56:23 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:56:23 user nova-compute[70374]:     </video>
Jul 27 09:56:23 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:56:23 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:56:23 user nova-compute[70374]:     </rng>
Jul 27 09:56:23 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:56:23 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:56:23 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:56:23 user nova-compute[70374]:     </memballoon>
Jul 27 09:56:23 user nova-compute[70374]:   </devices>
Jul 27 09:56:23 user nova-compute[70374]: </domain>
Jul 27 09:56:23 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-511472426',display_name='tempest-TestServerVolumeAttachmentScenario-server-511472426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-511472426',id=41,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1Ow03Du3uPk9avJfrKojKqoIIF6MhGHlipNV0srogeB/cEh5zYwe5cdeZRz+LA7E3LvF4hfHJpuTgj67k8ex7R4CsHShbuAw/6aw+s65Nc3LsIkhsX4ldpMv/KfJnwVg==',key_name='tempest-keypair-93327628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='638d25a4b11a4ddda2fb7b5775f8f396',ramdisk_id='',reservation_id='r-w2uipsn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1220688142',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1220688142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:56:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='127637a1ef10420881e9895927665f67',uuid=70cea63a-70b3-405e-b654-8ea7f1126412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Converting VIF {"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a9:24,bridge_name='br-int',has_traffic_filtering=True,id=7981eb37-eb74-45c4-98cd-42f9303161d0,network=Network(9baec0c8-d89b-4116-8bd2-d6d829d23505),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7981eb37-eb') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG os_vif [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a9:24,bridge_name='br-int',has_traffic_filtering=True,id=7981eb37-eb74-45c4-98cd-42f9303161d0,network=Network(9baec0c8-d89b-4116-8bd2-d6d829d23505),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7981eb37-eb') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7981eb37-eb, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7981eb37-eb, col_values=(('external_ids', {'iface-id': '7981eb37-eb74-45c4-98cd-42f9303161d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:a9:24', 'vm-uuid': '70cea63a-70b3-405e-b654-8ea7f1126412'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:23 user nova-compute[70374]: INFO os_vif [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a9:24,bridge_name='br-int',has_traffic_filtering=True,id=7981eb37-eb74-45c4-98cd-42f9303161d0,network=Network(9baec0c8-d89b-4116-8bd2-d6d829d23505),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7981eb37-eb')
Jul 27 09:56:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-16331862-900b-41c4-bc11-b5abd9dc001f tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.068s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:56:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No VIF found with MAC fa:16:3e:34:a9:24, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:56:24 user nova-compute[70374]: DEBUG nova.network.neutron [req-280f019d-0b54-49b3-a376-e3a2f351c51e req-06308f5e-5790-477a-9612-483d95079d5e service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updated VIF entry in instance network info cache for port 7981eb37-eb74-45c4-98cd-42f9303161d0. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:56:24 user nova-compute[70374]: DEBUG nova.network.neutron [req-280f019d-0b54-49b3-a376-e3a2f351c51e req-06308f5e-5790-477a-9612-483d95079d5e service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updating instance_info_cache with network_info: [{"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:56:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-280f019d-0b54-49b3-a376-e3a2f351c51e req-06308f5e-5790-477a-9612-483d95079d5e service nova] Releasing lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:56:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Skipping network cache update for instance because it is Building. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-59271578-a957-40ca-8f82-5698e73e4097 req-6be38612-d3b1-4a92-a504-361d5a641b37 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-59271578-a957-40ca-8f82-5698e73e4097 req-6be38612-d3b1-4a92-a504-361d5a641b37 service nova] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-59271578-a957-40ca-8f82-5698e73e4097 req-6be38612-d3b1-4a92-a504-361d5a641b37 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-59271578-a957-40ca-8f82-5698e73e4097 req-6be38612-d3b1-4a92-a504-361d5a641b37 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-59271578-a957-40ca-8f82-5698e73e4097 req-6be38612-d3b1-4a92-a504-361d5a641b37 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] No waiting events found dispatching network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:25 user nova-compute[70374]: WARNING nova.compute.manager [req-59271578-a957-40ca-8f82-5698e73e4097 req-6be38612-d3b1-4a92-a504-361d5a641b37 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received unexpected event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 for instance with vm_state building and task_state spawning.
Jul 27 09:56:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:56:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:56:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:56:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451787.38915, 70cea63a-70b3-405e-b654-8ea7f1126412 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:56:27 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] VM Resumed (Lifecycle Event)
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 09:56:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Instance spawned successfully.
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 09:56:27 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451787.3923922, 70cea63a-70b3-405e-b654-8ea7f1126412 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:56:27 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] VM Started (Lifecycle Event)
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-c8e79a7a-bfcb-4c33-ba9b-f6f5fb6f26ca req-24bf8202-a60e-445a-803c-395c4a1596f0 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c8e79a7a-bfcb-4c33-ba9b-f6f5fb6f26ca req-24bf8202-a60e-445a-803c-395c4a1596f0 service nova] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c8e79a7a-bfcb-4c33-ba9b-f6f5fb6f26ca req-24bf8202-a60e-445a-803c-395c4a1596f0 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c8e79a7a-bfcb-4c33-ba9b-f6f5fb6f26ca req-24bf8202-a60e-445a-803c-395c4a1596f0 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-c8e79a7a-bfcb-4c33-ba9b-f6f5fb6f26ca req-24bf8202-a60e-445a-803c-395c4a1596f0 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] No waiting events found dispatching network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:27 user nova-compute[70374]: WARNING nova.compute.manager [req-c8e79a7a-bfcb-4c33-ba9b-f6f5fb6f26ca req-24bf8202-a60e-445a-803c-395c4a1596f0 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received unexpected event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 for instance with vm_state building and task_state spawning.
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:56:27 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 09:56:27 user nova-compute[70374]: INFO nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Took 5.86 seconds to spawn the instance on the hypervisor.
Jul 27 09:56:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:27 user nova-compute[70374]: INFO nova.compute.manager [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Took 6.57 seconds to build instance.
Jul 27 09:56:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-67a99c71-8562-4ce1-b3b4-6b0923dccb5c tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.677s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:31 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:56:31 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=25.282085418701172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance f37b88a5-5935-4a36-8099-f21ebc27767d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 70cea63a-70b3-405e-b654-8ea7f1126412 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 09:56:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 09:56:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 09:56:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:46 user nova-compute[70374]: INFO nova.compute.manager [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Rescuing
Jul 27 09:56:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:56:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquired lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:56:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Releasing lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-18940d32-ff8b-4367-946c-ef12c511bd5d req-abae797e-09a5-4467-8221-aff268339675 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-18940d32-ff8b-4367-946c-ef12c511bd5d req-abae797e-09a5-4467-8221-aff268339675 service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-18940d32-ff8b-4367-946c-ef12c511bd5d req-abae797e-09a5-4467-8221-aff268339675 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-18940d32-ff8b-4367-946c-ef12c511bd5d req-abae797e-09a5-4467-8221-aff268339675 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-18940d32-ff8b-4367-946c-ef12c511bd5d req-abae797e-09a5-4467-8221-aff268339675 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:47 user nova-compute[70374]: WARNING nova.compute.manager [req-18940d32-ff8b-4367-946c-ef12c511bd5d req-abae797e-09a5-4467-8221-aff268339675 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state rescuing.
Jul 27 09:56:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance destroyed successfully.
Jul 27 09:56:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Attempting a stable device rescue
Jul 27 09:56:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70374) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 09:56:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance directory exists: not creating {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 09:56:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Creating image(s)
Jul 27 09:56:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "/opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "/opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "/opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:48 user nova-compute[70374]: DEBUG nova.objects.instance [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "197dcf922b72716a75babfc37a05fb97e31be851" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "197dcf922b72716a75babfc37a05fb97e31be851" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851.part --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.virt.images [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] c2370583-d794-45f8-bb6e-a79998b57972 was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851.part /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:49 user nova-compute[70374]: WARNING nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state rescuing.
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:49 user nova-compute[70374]: WARNING nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state rescuing.
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:49 user nova-compute[70374]: WARNING nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state rescuing.
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:49 user nova-compute[70374]: WARNING nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state rescuing.
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:49 user nova-compute[70374]: DEBUG nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:49 user nova-compute[70374]: WARNING nova.compute.manager [req-71421ea4-8c80-4eb6-9bf2-a571a7fc8f34 req-f41d7fa0-7c0b-4e27-88ae-f2c2c656722c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state rescuing.
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851.part /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851.converted" returned: 0 in 0.620s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "197dcf922b72716a75babfc37a05fb97e31be851" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.193s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "197dcf922b72716a75babfc37a05fb97e31be851" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "197dcf922b72716a75babfc37a05fb97e31be851" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851 --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851,backing_fmt=raw /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851,backing_fmt=raw /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue" returned: 0 in 0.049s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "197dcf922b72716a75babfc37a05fb97e31be851" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.objects.instance [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'migration_context' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Start _get_guest_xml network_info=[{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "vif_mac": "fa:16:3e:b3:c1:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c2370583-d794-45f8-bb6e-a79998b57972', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'de3f0f8a-14a4-4a12-95e7-435921c1efb8', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTeVNkLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '15c7721e-cebc-4f3a-a214-ea93ef21a80d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2eac07e-e7d4-4262-b19d-239eae23984d', 'serial': 'c2eac07e-e7d4-4262-b19d-239eae23984d'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.objects.instance [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'resources' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.objects.instance [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'numa_topology' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:50 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:56:50 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.objects.instance [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTeVNkLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:56:50 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:56:50 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:56:50 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab8ce4a-fd1c-44e5-a3cf-0133d6252496]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sTeVNkLR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 09:56:50 user nova-compute[70374]: node.name = iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 09:56:50 user nova-compute[70374]: node.tpgt = -1
Jul 27 09:56:50 user nova-compute[70374]: node.startup = automatic
Jul 27 09:56:50 user nova-compute[70374]: node.leading_login = No
Jul 27 09:56:50 user nova-compute[70374]: iface.iscsi_ifacename = default
Jul 27 09:56:50 user nova-compute[70374]: iface.net_ifacename = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.ipaddress = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.prefix_len = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.hwaddress = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.transport_name = tcp
Jul 27 09:56:50 user nova-compute[70374]: iface.initiatorname = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.state = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.vlan_id = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.vlan_priority = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.vlan_state = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.iface_num = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.mtu = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.port = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.bootproto = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.subnet_mask = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.gateway = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.dhcp_alt_client_id = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.dhcp_dns = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.dhcp_learn_iqn = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.dhcp_vendor_id_state = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.dhcp_vendor_id = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.dhcp_slp_da = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.fragmentation = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.gratuitous_arp = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.incoming_forwarding = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.tos_state = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.tos = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.ttl = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.delayed_ack = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.tcp_nagle = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.tcp_wsf_state = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.tcp_wsf = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.tcp_timer_scale = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.tcp_timestamp = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.redirect = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.def_task_mgmt_timeout = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.header_digest = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.data_digest = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.immediate_data = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.initial_r2t = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.data_seq_inorder = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.data_pdu_inorder = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.erl = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.max_receive_data_len = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.first_burst_len = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.max_outstanding_r2t = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.max_burst_len = 0
Jul 27 09:56:50 user nova-compute[70374]: iface.chap_auth = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.bidi_chap = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.strict_login_compliance = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.discovery_auth = <empty>
Jul 27 09:56:50 user nova-compute[70374]: iface.discovery_logout = <empty>
Jul 27 09:56:50 user nova-compute[70374]: node.discovery_address = <empty>
Jul 27 09:56:50 user nova-compute[70374]: node.discovery_port = 0
Jul 27 09:56:50 user nova-compute[70374]: node.discovery_type = static
Jul 27 09:56:50 user nova-compute[70374]: node.session.initial_cmdsn = 0
Jul 27 09:56:50 user nova-compute[70374]: node.session.initial_login_retry_max = 8
Jul 27 09:56:50 user nova-compute[70374]: node.session.xmit_thread_priority = -20
Jul 27 09:56:50 user nova-compute[70374]: node.session.cmds_max = 128
Jul 27 09:56:50 user nova-compute[70374]: node.session.queue_depth = 32
Jul 27 09:56:50 user nova-compute[70374]: node.session.nr_sessions = 1
Jul 27 09:56:50 user nova-compute[70374]: node.session.auth.authmethod = CHAP
Jul 27 09:56:50 user nova-compute[70374]: node.session.auth.username = sTeVNkLR
Jul 27 09:56:50 user nova-compute[70374]: node.session.auth.password = ***
Jul 27 09:56:50 user nova-compute[70374]: node.session.auth.username_in = <empty>
Jul 27 09:56:50 user nova-compute[70374]: node.session.auth.password_in = <empty>
Jul 27 09:56:50 user nova-compute[70374]: node.session.auth.chap_algs = MD5
Jul 27 09:56:50 user nova-compute[70374]: node.session.timeo.replacement_timeout = 120
Jul 27 09:56:50 user nova-compute[70374]: node.session.err_timeo.abort_timeout = 15
Jul 27 09:56:50 user nova-compute[70374]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 09:56:50 user nova-compute[70374]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 09:56:50 user nova-compute[70374]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.FastAbort = Yes
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.InitialR2T = No
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.ImmediateData = Yes
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.MaxConnections = 1
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 09:56:50 user nova-compute[70374]: node.session.iscsi.ERL = 0
Jul 27 09:56:50 user nova-compute[70374]: node.session.scan = manual
Jul 27 09:56:50 user nova-compute[70374]: node.session.reopen_max = 0
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].address = 172.16.0.220
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].port = 3260
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].startup = manual
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].tcp.window_size = 524288
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].tcp.type_of_service = 0
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].timeo.logout_timeout = 15
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].timeo.login_timeout = 15
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].timeo.auth_timeout = 45
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].iscsi.DataDigest = None
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].iscsi.IFMarker = No
Jul 27 09:56:50 user nova-compute[70374]: node.conn[0].iscsi.OFMarker = No
Jul 27 09:56:50 user nova-compute[70374]: # END RECORD
Jul 27 09:56:50 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[869d6ec3-d9dd-4444-8c0b-e3d28283dea7]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22c6538-b597-4be9-bbab-195782e49245]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTeVNkLR {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTeVNkLR" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c6ab2c-711b-4ea2-8185-5b39d76873da]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sTeVNkLR'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c1fe48-9937-412b-8fb3-4d9251584084]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad4174f-4f18-4e49-a1fe-d23b3cc2bb7f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:56:50 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:56:50 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] HCTL ('33', '0', '0', 0) found on session 43 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef7c539-f90a-45bc-9171-60e165bd2993]: (4, ('0 0 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching for a device in session 43 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTeVNkLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] <== connect_volume: return (165ms) {'type': 'block', 'scsi_wwn': '23964396137323939', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964396137323939', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1910797450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1910797450',id=38,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:55:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-62bd6028',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T09:55:13Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=15c7721e-cebc-4f3a-a214-ea93ef21a80d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "vif_mac": "fa:16:3e:b3:c1:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "vif_mac": "fa:16:3e:b3:c1:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c1:64,bridge_name='br-int',has_traffic_filtering=True,id=0de024ba-70c5-4ed4-b007-aaa78b431855,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de024ba-70') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.objects.instance [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'pci_devices' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 09:56:50 user nova-compute[70374]:   <uuid>15c7721e-cebc-4f3a-a214-ea93ef21a80d</uuid>
Jul 27 09:56:50 user nova-compute[70374]:   <name>instance-00000026</name>
Jul 27 09:56:50 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 09:56:50 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 09:56:50 user nova-compute[70374]:   <metadata>
Jul 27 09:56:50 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 09:56:50 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 09:56:50 user nova-compute[70374]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1910797450</nova:name>
Jul 27 09:56:50 user nova-compute[70374]:       <nova:creationTime>2023-07-27 09:56:50</nova:creationTime>
Jul 27 09:56:50 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 09:56:50 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 09:56:50 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 09:56:50 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 09:56:50 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 09:56:50 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 09:56:50 user nova-compute[70374]:       </nova:flavor>
Jul 27 09:56:50 user nova-compute[70374]:       <nova:owner>
Jul 27 09:56:50 user nova-compute[70374]:         <nova:user uuid="653bb45e82be4371b55519bbf5308711">tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member</nova:user>
Jul 27 09:56:50 user nova-compute[70374]:         <nova:project uuid="15442b359a014219b7854237eaaad0d3">tempest-ServerBootFromVolumeStableRescueTest-1815884142</nova:project>
Jul 27 09:56:50 user nova-compute[70374]:       </nova:owner>
Jul 27 09:56:50 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 09:56:50 user nova-compute[70374]:       <nova:ports>
Jul 27 09:56:50 user nova-compute[70374]:         <nova:port uuid="0de024ba-70c5-4ed4-b007-aaa78b431855">
Jul 27 09:56:50 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 09:56:50 user nova-compute[70374]:         </nova:port>
Jul 27 09:56:50 user nova-compute[70374]:       </nova:ports>
Jul 27 09:56:50 user nova-compute[70374]:     </nova:instance>
Jul 27 09:56:50 user nova-compute[70374]:   </metadata>
Jul 27 09:56:50 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 09:56:50 user nova-compute[70374]:     <system>
Jul 27 09:56:50 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 09:56:50 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 09:56:50 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 09:56:50 user nova-compute[70374]:       <entry name="serial">15c7721e-cebc-4f3a-a214-ea93ef21a80d</entry>
Jul 27 09:56:50 user nova-compute[70374]:       <entry name="uuid">15c7721e-cebc-4f3a-a214-ea93ef21a80d</entry>
Jul 27 09:56:50 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 09:56:50 user nova-compute[70374]:     </system>
Jul 27 09:56:50 user nova-compute[70374]:   </sysinfo>
Jul 27 09:56:50 user nova-compute[70374]:   <os>
Jul 27 09:56:50 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 09:56:50 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 09:56:50 user nova-compute[70374]:   </os>
Jul 27 09:56:50 user nova-compute[70374]:   <features>
Jul 27 09:56:50 user nova-compute[70374]:     <acpi/>
Jul 27 09:56:50 user nova-compute[70374]:     <apic/>
Jul 27 09:56:50 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 09:56:50 user nova-compute[70374]:   </features>
Jul 27 09:56:50 user nova-compute[70374]:   <clock offset="utc">
Jul 27 09:56:50 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 09:56:50 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 09:56:50 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 09:56:50 user nova-compute[70374]:   </clock>
Jul 27 09:56:50 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 09:56:50 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 09:56:50 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 09:56:50 user nova-compute[70374]:   </cpu>
Jul 27 09:56:50 user nova-compute[70374]:   <devices>
Jul 27 09:56:50 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 09:56:50 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:56:50 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 09:56:50 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 09:56:50 user nova-compute[70374]:       <serial>c2eac07e-e7d4-4262-b19d-239eae23984d</serial>
Jul 27 09:56:50 user nova-compute[70374]:     </disk>
Jul 27 09:56:50 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 09:56:50 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 09:56:50 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue"/>
Jul 27 09:56:50 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 09:56:50 user nova-compute[70374]:       <boot order="1"/>
Jul 27 09:56:50 user nova-compute[70374]:     </disk>
Jul 27 09:56:50 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 09:56:50 user nova-compute[70374]:       <mac address="fa:16:3e:b3:c1:64"/>
Jul 27 09:56:50 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:56:50 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 09:56:50 user nova-compute[70374]:       <target dev="tap0de024ba-70"/>
Jul 27 09:56:50 user nova-compute[70374]:     </interface>
Jul 27 09:56:50 user nova-compute[70374]:     <serial type="pty">
Jul 27 09:56:50 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/console.log" append="off"/>
Jul 27 09:56:50 user nova-compute[70374]:     </serial>
Jul 27 09:56:50 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 09:56:50 user nova-compute[70374]:     <video>
Jul 27 09:56:50 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 09:56:50 user nova-compute[70374]:     </video>
Jul 27 09:56:50 user nova-compute[70374]:     <rng model="virtio">
Jul 27 09:56:50 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 09:56:50 user nova-compute[70374]:     </rng>
Jul 27 09:56:50 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 09:56:50 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 09:56:50 user nova-compute[70374]:       <stats period="10"/>
Jul 27 09:56:50 user nova-compute[70374]:     </memballoon>
Jul 27 09:56:50 user nova-compute[70374]:   </devices>
Jul 27 09:56:50 user nova-compute[70374]: </domain>
Jul 27 09:56:50 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 09:56:50 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance destroyed successfully.
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:56:50 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No VIF found with MAC fa:16:3e:b3:c1:64, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-e924684d-3424-4a3a-9458-2fdc37f50700 req-345e93df-0960-422e-b3dc-728baffea24c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e924684d-3424-4a3a-9458-2fdc37f50700 req-345e93df-0960-422e-b3dc-728baffea24c service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e924684d-3424-4a3a-9458-2fdc37f50700 req-345e93df-0960-422e-b3dc-728baffea24c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e924684d-3424-4a3a-9458-2fdc37f50700 req-345e93df-0960-422e-b3dc-728baffea24c service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-e924684d-3424-4a3a-9458-2fdc37f50700 req-345e93df-0960-422e-b3dc-728baffea24c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:52 user nova-compute[70374]: WARNING nova.compute.manager [req-e924684d-3424-4a3a-9458-2fdc37f50700 req-345e93df-0960-422e-b3dc-728baffea24c service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state rescuing.
Jul 27 09:56:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-a3ddbef4-819a-4a50-aaae-f103df93c897 req-de7eb904-393f-4f21-bbfa-7d1a6cad1fa1 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a3ddbef4-819a-4a50-aaae-f103df93c897 req-de7eb904-393f-4f21-bbfa-7d1a6cad1fa1 service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a3ddbef4-819a-4a50-aaae-f103df93c897 req-de7eb904-393f-4f21-bbfa-7d1a6cad1fa1 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a3ddbef4-819a-4a50-aaae-f103df93c897 req-de7eb904-393f-4f21-bbfa-7d1a6cad1fa1 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.compute.manager [req-a3ddbef4-819a-4a50-aaae-f103df93c897 req-de7eb904-393f-4f21-bbfa-7d1a6cad1fa1 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:56:54 user nova-compute[70374]: WARNING nova.compute.manager [req-a3ddbef4-819a-4a50-aaae-f103df93c897 req-de7eb904-393f-4f21-bbfa-7d1a6cad1fa1 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state rescuing.
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 15c7721e-cebc-4f3a-a214-ea93ef21a80d due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451814.729294, 15c7721e-cebc-4f3a-a214-ea93ef21a80d => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:56:54 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] VM Resumed (Lifecycle Event)
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-25767120-c7f7-4b14-802a-bb0d9bef903a tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:56:54 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451814.7308285, 15c7721e-cebc-4f3a-a214-ea93ef21a80d => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:56:54 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] VM Started (Lifecycle Event)
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:56:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_power_states {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 708ed7e2-30d9-4a3f-85c8-55e74d98f233 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid f37b88a5-5935-4a36-8099-f21ebc27767d {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:56:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'flavor' on Instance uuid 708ed7e2-30d9-4a3f-85c8-55e74d98f233 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:20 user nova-compute[70374]: INFO nova.compute.manager [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Attaching volume a7143456-482e-46f5-9936-2f39222245a6 to /dev/vdb
Jul 27 09:57:20 user nova-compute[70374]: DEBUG os_brick.utils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[283cedc3-a404-4832-81e6-b31f22a570f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b5dd2d-af54-4480-8b23-4b556484e188]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c691a0d8-42f7-43d8-a18e-5feabd8a5a83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e14bf0-c8fd-4027-88b7-8122ddcc28fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:57:20 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:57:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e564c0-6c97-4cfc-9eeb-5938304daf39]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG os_brick.utils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:57:20 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating existing volume attachment record: 238e37e5-96ab-4477-a11b-156ee264a991 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:57:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:57:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:57:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VItzWlpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:57:27 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:57:27 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:57:27 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a39946-caae-4f32-a39b-cc1c540aa8d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:57:27 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacd2af4-a966-4287-b117-e1bf9bbae684]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6] added
Jul 27 09:57:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbbe60c-6dde-4093-b1b4-c345b74122be]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff600c51-d8d5-45cf-9ed8-27e5ea8a92e4]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VItzWlpD {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VItzWlpD" returned: 0 in 0.030s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9504f9a-4c84-4e97-8723-0dade6abeb08]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VItzWlpD'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[81878030-4bc2-432a-918c-daa89d1aef82]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd0fa1d-c554-4d2d-b9b4-43326239b198]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:57:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:57:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[751b6649-395a-40c1-bf09-b0d8e572f387]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6, portal: 172.16.0.220,3260]
Jul 27 09:57:27 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6, portal: 172.16.0.220,3260] successful.
Jul 27 09:57:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[935527df-76a4-4083-a618-ba912bc2e652]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f2371-adf3-4854-a29a-3f3d3d2d64e3]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:57:27 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:57:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:57:27 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:57:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaff5e9b-0965-4e4b-a72f-f10e01c591b4]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:57:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VItzWlpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23636303534303861', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636303534303861', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG nova.objects.instance [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'flavor' on Instance uuid 708ed7e2-30d9-4a3f-85c8-55e74d98f233 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:57:28 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:57:28 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:57:28 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:57:28 user nova-compute[70374]:   <serial>a7143456-482e-46f5-9936-2f39222245a6</serial>
Jul 27 09:57:28 user nova-compute[70374]: </disk>
Jul 27 09:57:28 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] No VIF found with MAC fa:16:3e:43:4f:51, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:57:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-767393e3-4d07-42b0-8a75-55fcf51cf3c0 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.334s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-fc40ccf6-4072-4d71-8cae-3799032360c0 req-0fe6fdbb-4fb7-4221-9305-a6be3505a595 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-fc40ccf6-4072-4d71-8cae-3799032360c0 req-0fe6fdbb-4fb7-4221-9305-a6be3505a595 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing instance network info cache due to event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fc40ccf6-4072-4d71-8cae-3799032360c0 req-0fe6fdbb-4fb7-4221-9305-a6be3505a595 service nova] Acquiring lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fc40ccf6-4072-4d71-8cae-3799032360c0 req-0fe6fdbb-4fb7-4221-9305-a6be3505a595 service nova] Acquired lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG nova.network.neutron [req-fc40ccf6-4072-4d71-8cae-3799032360c0 req-0fe6fdbb-4fb7-4221-9305-a6be3505a595 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG nova.network.neutron [req-fc40ccf6-4072-4d71-8cae-3799032360c0 req-0fe6fdbb-4fb7-4221-9305-a6be3505a595 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updated VIF entry in instance network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG nova.network.neutron [req-fc40ccf6-4072-4d71-8cae-3799032360c0 req-0fe6fdbb-4fb7-4221-9305-a6be3505a595 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-fc40ccf6-4072-4d71-8cae-3799032360c0 req-0fe6fdbb-4fb7-4221-9305-a6be3505a595 service nova] Releasing lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:57:32 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-b9aa316a-9d26-414b-89fb-33de8180f023 req-cda6618e-440f-4f9c-8c44-6e9142c3af0b service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-b9aa316a-9d26-414b-89fb-33de8180f023 req-cda6618e-440f-4f9c-8c44-6e9142c3af0b service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing instance network info cache due to event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b9aa316a-9d26-414b-89fb-33de8180f023 req-cda6618e-440f-4f9c-8c44-6e9142c3af0b service nova] Acquiring lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b9aa316a-9d26-414b-89fb-33de8180f023 req-cda6618e-440f-4f9c-8c44-6e9142c3af0b service nova] Acquired lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-b9aa316a-9d26-414b-89fb-33de8180f023 req-cda6618e-440f-4f9c-8c44-6e9142c3af0b service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:57:33 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:57:33 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8179MB free_disk=25.113422393798828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance f37b88a5-5935-4a36-8099-f21ebc27767d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 70cea63a-70b3-405e-b654-8ea7f1126412 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:33 user nova-compute[70374]: INFO nova.compute.manager [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Rebooting instance
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-b9aa316a-9d26-414b-89fb-33de8180f023 req-cda6618e-440f-4f9c-8c44-6e9142c3af0b service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updated VIF entry in instance network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.network.neutron [req-b9aa316a-9d26-414b-89fb-33de8180f023 req-cda6618e-440f-4f9c-8c44-6e9142c3af0b service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b9aa316a-9d26-414b-89fb-33de8180f023 req-cda6618e-440f-4f9c-8c44-6e9142c3af0b service nova] Releasing lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquired lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:57:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:57:34 user nova-compute[70374]: DEBUG nova.network.neutron [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:57:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Releasing lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:57:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:57:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:34 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:34 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:57:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-4cc04283-5c66-4824-bea4-66bc00ca75b1 req-4f9b5b91-ab25-4888-aede-94e406ca2251 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-unplugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4cc04283-5c66-4824-bea4-66bc00ca75b1 req-4f9b5b91-ab25-4888-aede-94e406ca2251 service nova] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4cc04283-5c66-4824-bea4-66bc00ca75b1 req-4f9b5b91-ab25-4888-aede-94e406ca2251 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4cc04283-5c66-4824-bea4-66bc00ca75b1 req-4f9b5b91-ab25-4888-aede-94e406ca2251 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-4cc04283-5c66-4824-bea4-66bc00ca75b1 req-4f9b5b91-ab25-4888-aede-94e406ca2251 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] No waiting events found dispatching network-vif-unplugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:57:36 user nova-compute[70374]: WARNING nova.compute.manager [req-4cc04283-5c66-4824-bea4-66bc00ca75b1 req-4f9b5b91-ab25-4888-aede-94e406ca2251 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received unexpected event network-vif-unplugged-f39e8958-b93d-4b15-8356-edb95877df4c for instance with vm_state active and task_state reboot_started.
Jul 27 09:57:37 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Instance shutdown successfully.
Jul 27 09:57:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-118d1f78-903d-44a1-8de1-1d4d34a7cac0 req-e72891ef-3d53-44c8-a0dc-7b43b9981b56 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:57:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-118d1f78-903d-44a1-8de1-1d4d34a7cac0 req-e72891ef-3d53-44c8-a0dc-7b43b9981b56 service nova] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-118d1f78-903d-44a1-8de1-1d4d34a7cac0 req-e72891ef-3d53-44c8-a0dc-7b43b9981b56 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-118d1f78-903d-44a1-8de1-1d4d34a7cac0 req-e72891ef-3d53-44c8-a0dc-7b43b9981b56 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-118d1f78-903d-44a1-8de1-1d4d34a7cac0 req-e72891ef-3d53-44c8-a0dc-7b43b9981b56 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] No waiting events found dispatching network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:57:39 user nova-compute[70374]: WARNING nova.compute.manager [req-118d1f78-903d-44a1-8de1-1d4d34a7cac0 req-e72891ef-3d53-44c8-a0dc-7b43b9981b56 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received unexpected event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c for instance with vm_state active and task_state reboot_started.
Jul 27 09:57:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] No waiting events found dispatching network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:57:41 user nova-compute[70374]: WARNING nova.compute.manager [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received unexpected event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c for instance with vm_state active and task_state reboot_started.
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] No waiting events found dispatching network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:57:41 user nova-compute[70374]: WARNING nova.compute.manager [req-45403a90-0fdc-42bd-b556-787592e9d5e5 req-6a492592-8278-4486-872a-f011002a3b91 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received unexpected event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c for instance with vm_state active and task_state reboot_started.
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 708ed7e2-30d9-4a3f-85c8-55e74d98f233 due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451861.1259282, 708ed7e2-30d9-4a3f-85c8-55e74d98f233 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:57:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] VM Resumed (Lifecycle Event)
Jul 27 09:57:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Instance running successfully.
Jul 27 09:57:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Instance soft rebooted successfully.
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:57:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451861.1272185, 708ed7e2-30d9-4a3f-85c8-55e74d98f233 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:57:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] VM Started (Lifecycle Event)
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:57:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-72e62f45-eac6-447a-901f-b9e5c4a683d8 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.606s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:57:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:57:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:58:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-c5314eef-d2da-489b-bf2a-5b746e622877 req-9d17f6e7-c76e-4a3d-a41b-61ab38ba6202 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received event network-changed-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:58:07 user nova-compute[70374]: DEBUG nova.compute.manager [req-c5314eef-d2da-489b-bf2a-5b746e622877 req-9d17f6e7-c76e-4a3d-a41b-61ab38ba6202 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Refreshing instance network info cache due to event network-changed-7caf0700-cf05-4bf1-9663-8ef0565f0002. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:58:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c5314eef-d2da-489b-bf2a-5b746e622877 req-9d17f6e7-c76e-4a3d-a41b-61ab38ba6202 service nova] Acquiring lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:58:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c5314eef-d2da-489b-bf2a-5b746e622877 req-9d17f6e7-c76e-4a3d-a41b-61ab38ba6202 service nova] Acquired lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:58:07 user nova-compute[70374]: DEBUG nova.network.neutron [req-c5314eef-d2da-489b-bf2a-5b746e622877 req-9d17f6e7-c76e-4a3d-a41b-61ab38ba6202 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Refreshing network info cache for port 7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:58:08 user nova-compute[70374]: DEBUG nova.network.neutron [req-c5314eef-d2da-489b-bf2a-5b746e622877 req-9d17f6e7-c76e-4a3d-a41b-61ab38ba6202 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Updated VIF entry in instance network info cache for port 7caf0700-cf05-4bf1-9663-8ef0565f0002. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:58:08 user nova-compute[70374]: DEBUG nova.network.neutron [req-c5314eef-d2da-489b-bf2a-5b746e622877 req-9d17f6e7-c76e-4a3d-a41b-61ab38ba6202 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Updating instance_info_cache with network_info: [{"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:58:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c5314eef-d2da-489b-bf2a-5b746e622877 req-9d17f6e7-c76e-4a3d-a41b-61ab38ba6202 service nova] Releasing lock "refresh_cache-f37b88a5-5935-4a36-8099-f21ebc27767d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:58:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-29bfc4f3-7fb7-4c60-ae0d-00c316481017 req-cd77ba64-1ec6-4411-a68a-1d380cbdb780 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-changed-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-29bfc4f3-7fb7-4c60-ae0d-00c316481017 req-cd77ba64-1ec6-4411-a68a-1d380cbdb780 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Refreshing instance network info cache due to event network-changed-7981eb37-eb74-45c4-98cd-42f9303161d0. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-29bfc4f3-7fb7-4c60-ae0d-00c316481017 req-cd77ba64-1ec6-4411-a68a-1d380cbdb780 service nova] Acquiring lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-29bfc4f3-7fb7-4c60-ae0d-00c316481017 req-cd77ba64-1ec6-4411-a68a-1d380cbdb780 service nova] Acquired lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-29bfc4f3-7fb7-4c60-ae0d-00c316481017 req-cd77ba64-1ec6-4411-a68a-1d380cbdb780 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Refreshing network info cache for port 7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lazy-loading 'flavor' on Instance uuid f37b88a5-5935-4a36-8099-f21ebc27767d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-29bfc4f3-7fb7-4c60-ae0d-00c316481017 req-cd77ba64-1ec6-4411-a68a-1d380cbdb780 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updated VIF entry in instance network info cache for port 7981eb37-eb74-45c4-98cd-42f9303161d0. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-29bfc4f3-7fb7-4c60-ae0d-00c316481017 req-cd77ba64-1ec6-4411-a68a-1d380cbdb780 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updating instance_info_cache with network_info: [{"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-29bfc4f3-7fb7-4c60-ae0d-00c316481017 req-cd77ba64-1ec6-4411-a68a-1d380cbdb780 service nova] Releasing lock "refresh_cache-70cea63a-70b3-405e-b654-8ea7f1126412" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:12 user nova-compute[70374]: INFO nova.compute.manager [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Attaching volume e2120771-8e67-4679-80a8-0472b6792b12 to /dev/vdb
Jul 27 09:58:12 user nova-compute[70374]: DEBUG os_brick.utils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a310057c-0e2f-4f7b-bda0-1151f36e7349]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[00607179-8031-4fea-834e-6fdf47db0153]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'flavor' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f2cce4-4acb-4843-909b-a02ed600247d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5ab9e-eae7-4f29-bfe3-5e17de7f79b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:58:12 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10e132b-1195-44ac-85da-f5eead80b852]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG os_brick.utils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Updating existing volume attachment record: 4eb195bd-cf27-4ded-bbde-a948c7081319 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:12 user nova-compute[70374]: INFO nova.compute.manager [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Attaching volume d58bfe61-91c1-4978-b90a-1dbfb112830e to /dev/vdb
Jul 27 09:58:13 user nova-compute[70374]: DEBUG os_brick.utils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[433f4627-879c-4340-bcf7-179fc39295fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f29b62-0b6e-42ca-a987-e8c1f13c0283]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e61164-911b-4dfc-8c28-6062bfe29faa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe86f01-ed5c-466a-b2e8-a40d93454bec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:58:13 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:58:13 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d000c8-4155-4cca-85f9-2903ec16b246]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG os_brick.utils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:58:13 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updating existing volume attachment record: 4e19e4e2-24e8-4fe6-9116-c216ba452f9c {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:58:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnUAgrDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:58:19 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:58:19 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:58:19 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fadb972-1d6c-4d56-ac93-0e93580ac7ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:58:19 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f696b250-54e2-4d5e-8bfb-ef54815a0a32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12] added
Jul 27 09:58:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBxnZDFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:58:19 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[05105b2e-303f-4ad4-aa02-b361e30b7e03]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c14fd-273b-4efe-8a1e-c37ea3ca1d4d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnUAgrDX {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnUAgrDX" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5371a6a1-19ae-48d5-ba74-69837da3294a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnUAgrDX'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[be737719-80d2-4754-8e72-0dd4a93bfc2d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8551af3-dbd4-461a-8bb8-907aedc9b440]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:19 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:19 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34edf43-2814-422b-b727-bcd024011530]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12, portal: 172.16.0.220,3260]
Jul 27 09:58:19 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12, portal: 172.16.0.220,3260] successful.
Jul 27 09:58:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1401f-a8fe-4b67-8a96-4e748805a82c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4c5f1c-9403-493c-b192-bdf2f26ac9eb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:19 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:19 user nova-compute[70374]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)
Jul 27 09:58:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:19 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:19 user nova-compute[70374]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)
Jul 27 09:58:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[703ad74f-2aca-4291-9c8d-5aca5f9dbe1a]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:58:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnUAgrDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26164303531383464', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164303531383464', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.252s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:58:20 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:58:20 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lazy-loading 'flavor' on Instance uuid f37b88a5-5935-4a36-8099-f21ebc27767d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43fbdf5-ca91-47d9-a697-050fdcd0d579]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:58:20 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:58:20 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:58:20 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:58:20 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:58:20 user nova-compute[70374]:   <serial>e2120771-8e67-4679-80a8-0472b6792b12</serial>
Jul 27 09:58:20 user nova-compute[70374]: </disk>
Jul 27 09:58:20 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a489a7-4b23-458b-aa08-29b28ad499fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e] added
Jul 27 09:58:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddfa72d-2bce-45b8-aeb4-d671403acdac]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebd501e-c892-4c00-99cd-8e6e84df4c78]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBxnZDFo {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBxnZDFo" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65fa7d-d6ef-4700-ab96-188605d2d33a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UBxnZDFo'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ccb9e0-3616-41f0-956d-6fc35c0aac4f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be1def1-e4f2-4b46-8123-956db68cab7e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:20 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:20 user nova-compute[70374]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)
Jul 27 09:58:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:20 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:20 user nova-compute[70374]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)
Jul 27 09:58:20 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:58:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d59898-1098-4ca6-b9ac-81722ddade98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e, portal: 172.16.0.220,3260]
Jul 27 09:58:21 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e, portal: 172.16.0.220,3260] successful.
Jul 27 09:58:21 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c363773-f3ff-4868-9c1d-82dd7a1cb7ad]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a7543d-133d-4fa1-80fa-ba621ef9f9ac]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:21 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:21 user nova-compute[70374]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)
Jul 27 09:58:21 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:21 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:21 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:21 user nova-compute[70374]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)
Jul 27 09:58:21 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:21 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.034s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11a3d0e-e7e2-474d-af2a-4f9cc7fdca6e]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] No VIF found with MAC fa:16:3e:cd:72:a4, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:58:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9902acef-6efa-4f84-9446-e832ad5da645 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.810s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBxnZDFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] <== connect_volume: return (2580ms) {'type': 'block', 'scsi_wwn': '23039666136646666', 'path': '/dev/sde'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039666136646666', 'path': '/dev/sde'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'flavor' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:58:22 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:58:22 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:58:22 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:58:22 user nova-compute[70374]:   <serial>d58bfe61-91c1-4978-b90a-1dbfb112830e</serial>
Jul 27 09:58:22 user nova-compute[70374]: </disk>
Jul 27 09:58:22 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No VIF found with MAC fa:16:3e:34:a9:24, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:58:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ca5336ea-04ba-4160-9307-3a66417d3c95 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.754s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:23 user nova-compute[70374]: INFO nova.compute.manager [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Detaching volume e2120771-8e67-4679-80a8-0472b6792b12
Jul 27 09:58:23 user nova-compute[70374]: INFO nova.virt.block_device [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Attempting to driver detach volume e2120771-8e67-4679-80a8-0472b6792b12 from mountpoint /dev/vdb
Jul 27 09:58:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Attempting to detach device vdb from instance f37b88a5-5935-4a36-8099-f21ebc27767d from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:58:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:58:23 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:58:23 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:58:23 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:58:23 user nova-compute[70374]:   <serial>e2120771-8e67-4679-80a8-0472b6792b12</serial>
Jul 27 09:58:23 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:58:23 user nova-compute[70374]: </disk>
Jul 27 09:58:23 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:58:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Successfully detached device vdb from instance f37b88a5-5935-4a36-8099-f21ebc27767d from the persistent domain config.
Jul 27 09:58:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f37b88a5-5935-4a36-8099-f21ebc27767d from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:58:23 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:58:23 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:58:23 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:58:23 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:58:23 user nova-compute[70374]:   <serial>e2120771-8e67-4679-80a8-0472b6792b12</serial>
Jul 27 09:58:23 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:58:23 user nova-compute[70374]: </disk>
Jul 27 09:58:23 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451904.2427018, f37b88a5-5935-4a36-8099-f21ebc27767d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f37b88a5-5935-4a36-8099-f21ebc27767d {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:58:24 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Successfully detached device vdb from instance f37b88a5-5935-4a36-8099-f21ebc27767d from the live domain config.
Jul 27 09:58:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnUAgrDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:58:24 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a6f061-da08-4b0d-afb9-a52097b8408b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:58:24 user nova-compute[70374]: No targets found.
Jul 27 09:58:24 user nova-compute[70374]: iSNS:
Jul 27 09:58:24 user nova-compute[70374]: No targets found.
Jul 27 09:58:24 user nova-compute[70374]: STATIC:
Jul 27 09:58:24 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6
Jul 27 09:58:24 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:58:24 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:58:24 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e
Jul 27 09:58:24 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:58:24 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:58:24 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12
Jul 27 09:58:24 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:58:24 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:58:24 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 09:58:24 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:58:24 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:58:24 user nova-compute[70374]: FIRMWARE:
Jul 27 09:58:24 user nova-compute[70374]: No targets found.
Jul 27 09:58:24 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:58:24 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:58:24 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0155af97-1101-43ad-9d1e-3a066ade85d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af6a62-f36d-46de-ac03-e4bca5df4848]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:24 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:24 user nova-compute[70374]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)
Jul 27 09:58:24 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:24 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:24 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:24 user nova-compute[70374]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 (non-flash)
Jul 27 09:58:24 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:24 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc481f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b8575-7cae-475e-a569-d1dc262b49bf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8568dcf5-3fad-4117-8b7c-a336b93dba63]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80753ea-0109-4120-8e9a-9b50df559825]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a61cc0-acae-4596-979d-bf66d1de84c2]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e83874-29d9-42a6-8034-42959d2d352a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8854bf-68c8-4628-a1c5-f3c03d8c0c83]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12, portal: 172.16.0.220,3260]
Jul 27 09:58:24 user nova-compute[70374]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12, portal: 172.16.0.220,3260] successful.
Jul 27 09:58:24 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2120771-8e67-4679-80a8-0472b6792b12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cbb919-efa8-4898-8f98-056dc620c82a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] <== disconnect_volume: return (312ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:58:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:58:25 user nova-compute[70374]: DEBUG nova.objects.instance [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lazy-loading 'flavor' on Instance uuid f37b88a5-5935-4a36-8099-f21ebc27767d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:25 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:58:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-bc15fcc1-81bc-4fcf-b265-0bf0221b9d96 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'flavor' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:26 user nova-compute[70374]: INFO nova.compute.manager [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Attaching volume 3f04abe9-78c1-4280-b219-b00a86a0c4db to /dev/vdc
Jul 27 09:58:26 user nova-compute[70374]: DEBUG os_brick.utils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[71493fd8-76e1-4709-8d2a-b5ef2b382c4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fee4676-ab47-4db2-935a-6ff45109f6bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f130029b-31d5-488c-89c9-d8e44998867c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b267a397-9c97-4656-83ef-ec71309a9cfc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 09:58:26 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 09:58:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[23da4984-190d-4dd5-9447-6bc34442f807]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG os_brick.utils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:58:26 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updating existing volume attachment record: 322d1d13-454a-452d-8eb6-c4fbc98ff6c6 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 09:58:27 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLjhKIHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:58:33 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:58:33 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:58:33 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d6072-b30a-4a87-9d18-53ee4b5b2563]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 09:58:33 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fa21c4-8c93-4ea0-9840-c2a4c53717cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db] added
Jul 27 09:58:33 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc94f1e-3561-4e89-88ef-a522da8336db]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[661958d5-d843-459b-8f09-81bee34a9d19]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xLjhKIHa {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xLjhKIHa" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa96c05-bf66-4bbc-b5b8-1587b8549c9d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xLjhKIHa'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3435a1-3dae-4b84-af44-d487ae0e3352]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be58a8-ceaf-466f-8347-8cefe686e7bb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:33 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:33 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eccc43-66d0-4000-9d7e-6a4b6a39b4e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db, portal: 172.16.0.220,3260]
Jul 27 09:58:33 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db, portal: 172.16.0.220,3260] successful.
Jul 27 09:58:33 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb1d98-b100-4507-bd51-00a1339b1990]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5c2e3-af8a-4100-87c0-a60b2d6bb22d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db (non-flash)
Jul 27 09:58:33 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:33 user nova-compute[70374]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db (non-flash)
Jul 27 09:58:33 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6000a625-7196-4dde-bb66-84984a7fd7d1]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLjhKIHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26561396633386231', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561396633386231', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'flavor' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 09:58:34 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:58:34 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:58:34 user nova-compute[70374]:   <target dev="vdc" bus="virtio"/>
Jul 27 09:58:34 user nova-compute[70374]:   <serial>3f04abe9-78c1-4280-b219-b00a86a0c4db</serial>
Jul 27 09:58:34 user nova-compute[70374]: </disk>
Jul 27 09:58:34 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:34 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:58:35 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:58:35 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8253MB free_disk=25.102157592773438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] No VIF found with MAC fa:16:3e:34:a9:24, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance f37b88a5-5935-4a36-8099-f21ebc27767d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 70cea63a-70b3-405e-b654-8ea7f1126412 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8f8c651c-7bb4-4b31-8c4c-e2aec42ea377 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.270s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:58:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:36 user nova-compute[70374]: INFO nova.compute.manager [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Detaching volume 3f04abe9-78c1-4280-b219-b00a86a0c4db
Jul 27 09:58:36 user nova-compute[70374]: INFO nova.virt.block_device [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Attempting to driver detach volume 3f04abe9-78c1-4280-b219-b00a86a0c4db from mountpoint /dev/vdc
Jul 27 09:58:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Attempting to detach device vdc from instance 70cea63a-70b3-405e-b654-8ea7f1126412 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:58:36 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:58:36 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:58:36 user nova-compute[70374]:   <target dev="vdc" bus="virtio"/>
Jul 27 09:58:36 user nova-compute[70374]:   <serial>3f04abe9-78c1-4280-b219-b00a86a0c4db</serial>
Jul 27 09:58:36 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 09:58:36 user nova-compute[70374]: </disk>
Jul 27 09:58:36 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:58:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Successfully detached device vdc from instance 70cea63a-70b3-405e-b654-8ea7f1126412 from the persistent domain config.
Jul 27 09:58:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 70cea63a-70b3-405e-b654-8ea7f1126412 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:58:36 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:58:36 user nova-compute[70374]:   <source dev="/dev/sdd"/>
Jul 27 09:58:36 user nova-compute[70374]:   <target dev="vdc" bus="virtio"/>
Jul 27 09:58:36 user nova-compute[70374]:   <serial>3f04abe9-78c1-4280-b219-b00a86a0c4db</serial>
Jul 27 09:58:36 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 09:58:36 user nova-compute[70374]: </disk>
Jul 27 09:58:36 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451916.9043586, 70cea63a-70b3-405e-b654-8ea7f1126412 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:58:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Successfully detached device vdc from instance 70cea63a-70b3-405e-b654-8ea7f1126412 from the live domain config.
Jul 27 09:58:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLjhKIHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:58:36 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c36d67-8d2b-4193-b104-bc19b12832aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:58:36 user nova-compute[70374]: No targets found.
Jul 27 09:58:36 user nova-compute[70374]: iSNS:
Jul 27 09:58:36 user nova-compute[70374]: No targets found.
Jul 27 09:58:36 user nova-compute[70374]: STATIC:
Jul 27 09:58:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6
Jul 27 09:58:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:58:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:58:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e
Jul 27 09:58:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:58:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:58:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db
Jul 27 09:58:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:58:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:58:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 09:58:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:58:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:58:36 user nova-compute[70374]: FIRMWARE:
Jul 27 09:58:36 user nova-compute[70374]: No targets found.
Jul 27 09:58:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:58:36 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:58:36 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b8bd59-44f1-4924-9326-0503d5b96eba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad99884-9347-43fd-8c7f-a91aa7d74038]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:36 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:36 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:36 user nova-compute[70374]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db (non-flash)
Jul 27 09:58:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:58:36 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:58:36 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:58:36 user nova-compute[70374]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db (non-flash)
Jul 27 09:58:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc1205e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:58:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfab22d-cca2-4fc2-8e8a-097fca2b5410]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58c299e-b054-4d20-83cc-a5fad7575b8b]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1564ca-fd17-4431-81cb-e3ba97210138]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb74bc1-2042-4b11-9f3f-94ef6c231fd1]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:37 user nova-compute[70374]: INFO nova.compute.manager [None req-3170f1de-7dbb-4e65-859c-fd89b091cc03 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Unrescuing
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3170f1de-7dbb-4e65-859c-fd89b091cc03 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3170f1de-7dbb-4e65-859c-fd89b091cc03 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquired lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-3170f1de-7dbb-4e65-859c-fd89b091cc03 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1711a1f-c6ba-46fa-9599-23373c910aa8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2668c506-6df4-4828-ba19-ee7ba8a74ca0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db, portal: 172.16.0.220,3260]
Jul 27 09:58:37 user nova-compute[70374]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db, portal: 172.16.0.220,3260] successful.
Jul 27 09:58:37 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f04abe9-78c1-4280-b219-b00a86a0c4db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd6a9b-9380-4850-a851-86a0db890c24]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] <== disconnect_volume: return (322ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-3170f1de-7dbb-4e65-859c-fd89b091cc03 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-3170f1de-7dbb-4e65-859c-fd89b091cc03 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Releasing lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG nova.objects.instance [None req-3170f1de-7dbb-4e65-859c-fd89b091cc03 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'flavor' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-7b7e02cf-5452-4494-aca1-c92e59d67bd9 req-23c06e06-df57-4b8c-94db-498e95806ca6 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b7e02cf-5452-4494-aca1-c92e59d67bd9 req-23c06e06-df57-4b8c-94db-498e95806ca6 service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b7e02cf-5452-4494-aca1-c92e59d67bd9 req-23c06e06-df57-4b8c-94db-498e95806ca6 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7b7e02cf-5452-4494-aca1-c92e59d67bd9 req-23c06e06-df57-4b8c-94db-498e95806ca6 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-7b7e02cf-5452-4494-aca1-c92e59d67bd9 req-23c06e06-df57-4b8c-94db-498e95806ca6 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:58:37 user nova-compute[70374]: WARNING nova.compute.manager [req-7b7e02cf-5452-4494-aca1-c92e59d67bd9 req-23c06e06-df57-4b8c-94db-498e95806ca6 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:58:37 user nova-compute[70374]: DEBUG nova.objects.instance [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'flavor' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:58:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-09e9b96e-6ca6-4c2b-b36e-48d167f343f2 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:38 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance destroyed successfully.
Jul 27 09:58:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:58:40 user nova-compute[70374]: WARNING nova.compute.manager [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:58:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:58:40 user nova-compute[70374]: WARNING nova.compute.manager [req-e3c3138f-ce4c-4c68-a40c-65e8023cc863 req-73457454-9dc1-4d39-98f2-b97c011dd4de service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state rescued and task_state unrescuing.
Jul 27 09:58:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 15c7721e-cebc-4f3a-a214-ea93ef21a80d due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 09:58:41 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451921.8643804, 15c7721e-cebc-4f3a-a214-ea93ef21a80d => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:58:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] VM Resumed (Lifecycle Event)
Jul 27 09:58:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-3170f1de-7dbb-4e65-859c-fd89b091cc03 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:58:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:58:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:58:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 09:58:41 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690451921.866402, 15c7721e-cebc-4f3a-a214-ea93ef21a80d => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:58:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] VM Started (Lifecycle Event)
Jul 27 09:58:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:58:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 09:58:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-63414425-4904-47f7-8ef8-f9e3ba789183 req-6308a244-52ad-41a5-b017-dabea090977d service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:58:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63414425-4904-47f7-8ef8-f9e3ba789183 req-6308a244-52ad-41a5-b017-dabea090977d service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:58:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63414425-4904-47f7-8ef8-f9e3ba789183 req-6308a244-52ad-41a5-b017-dabea090977d service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:58:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-63414425-4904-47f7-8ef8-f9e3ba789183 req-6308a244-52ad-41a5-b017-dabea090977d service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:58:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-63414425-4904-47f7-8ef8-f9e3ba789183 req-6308a244-52ad-41a5-b017-dabea090977d service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:58:42 user nova-compute[70374]: WARNING nova.compute.manager [req-63414425-4904-47f7-8ef8-f9e3ba789183 req-6308a244-52ad-41a5-b017-dabea090977d service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state None.
Jul 27 09:58:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:48 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:58:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:58:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:58:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:58:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:58:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:58:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:59:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:59:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:19 user nova-compute[70374]: INFO nova.compute.manager [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Terminating instance
Jul 27 09:59:19 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-6fa95b02-becf-45f2-9455-3dbaf93ddc00 req-9489c36e-fc32-465f-ac98-87d0a71a6bfe service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received event network-vif-unplugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6fa95b02-becf-45f2-9455-3dbaf93ddc00 req-9489c36e-fc32-465f-ac98-87d0a71a6bfe service nova] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6fa95b02-becf-45f2-9455-3dbaf93ddc00 req-9489c36e-fc32-465f-ac98-87d0a71a6bfe service nova] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6fa95b02-becf-45f2-9455-3dbaf93ddc00 req-9489c36e-fc32-465f-ac98-87d0a71a6bfe service nova] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-6fa95b02-becf-45f2-9455-3dbaf93ddc00 req-9489c36e-fc32-465f-ac98-87d0a71a6bfe service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] No waiting events found dispatching network-vif-unplugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:59:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-6fa95b02-becf-45f2-9455-3dbaf93ddc00 req-9489c36e-fc32-465f-ac98-87d0a71a6bfe service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received event network-vif-unplugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Instance destroyed successfully.
Jul 27 09:59:20 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lazy-loading 'resources' on Instance uuid f37b88a5-5935-4a36-8099-f21ebc27767d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210607775',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1210607775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210607',id=40,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd5vocl1CW/v62dSHdQ7HFBPZdrSJksTrcO7PiFg+0VHWygx+wcMCmtUQq+qzuE6p8VLbTDk5I5wl8zSjnISWWEpfNULT5MNX2D9f8viv9wzLLCdAEBFbBWg2tGiTVGrw==',key_name='tempest-keypair-1410515328',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:56:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45d61f8c09d9489d9d1a7672f50c8d34',ramdisk_id='',reservation_id='r-mn0h76k4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1976831533',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0dcf241bc6e46578bae97c3905188d3',uuid=f37b88a5-5935-4a36-8099-f21ebc27767d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Converting VIF {"id": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "address": "fa:16:3e:cd:72:a4", "network": {"id": "39e3ac5a-7dc7-44b7-8c28-a2658eac7567", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-579895333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d61f8c09d9489d9d1a7672f50c8d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7caf0700-cf", "ovs_interfaceid": "7caf0700-cf05-4bf1-9663-8ef0565f0002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=7caf0700-cf05-4bf1-9663-8ef0565f0002,network=Network(39e3ac5a-7dc7-44b7-8c28-a2658eac7567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7caf0700-cf') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG os_vif [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=7caf0700-cf05-4bf1-9663-8ef0565f0002,network=Network(39e3ac5a-7dc7-44b7-8c28-a2658eac7567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7caf0700-cf') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7caf0700-cf, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:59:20 user nova-compute[70374]: INFO os_vif [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=7caf0700-cf05-4bf1-9663-8ef0565f0002,network=Network(39e3ac5a-7dc7-44b7-8c28-a2658eac7567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7caf0700-cf')
Jul 27 09:59:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Deleting instance files /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d_del
Jul 27 09:59:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Deletion of /opt/stack/data/nova/instances/f37b88a5-5935-4a36-8099-f21ebc27767d_del complete
Jul 27 09:59:20 user nova-compute[70374]: INFO nova.compute.manager [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 09:59:20 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 09:59:20 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:59:21 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Took 0.72 seconds to deallocate network for instance.
Jul 27 09:59:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-0a9c029b-f072-4aeb-a6a3-e5f02d74d985 req-b0ac1c6d-97ac-4e15-bccc-fd1256cbd157 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received event network-vif-deleted-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:59:21 user nova-compute[70374]: INFO nova.compute.manager [req-0a9c029b-f072-4aeb-a6a3-e5f02d74d985 req-b0ac1c6d-97ac-4e15-bccc-fd1256cbd157 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Neutron deleted interface 7caf0700-cf05-4bf1-9663-8ef0565f0002; detaching it from the instance and deleting it from the info cache
Jul 27 09:59:21 user nova-compute[70374]: DEBUG nova.network.neutron [req-0a9c029b-f072-4aeb-a6a3-e5f02d74d985 req-b0ac1c6d-97ac-4e15-bccc-fd1256cbd157 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-0a9c029b-f072-4aeb-a6a3-e5f02d74d985 req-b0ac1c6d-97ac-4e15-bccc-fd1256cbd157 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Detach interface failed, port_id=7caf0700-cf05-4bf1-9663-8ef0565f0002, reason: Instance f37b88a5-5935-4a36-8099-f21ebc27767d could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:21 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Deleted allocations for instance f37b88a5-5935-4a36-8099-f21ebc27767d
Jul 27 09:59:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b772628-f43d-4b35-80b3-98d4e89ddaf3 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533 tempest-TestServerVolumeAttachScenarioOldVersion-1976831533-project-member] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-a093960d-5311-42c4-8fbd-7d5ba1eb1580 req-602ef643-eff3-4b60-ae61-825da5adf335 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received event network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a093960d-5311-42c4-8fbd-7d5ba1eb1580 req-602ef643-eff3-4b60-ae61-825da5adf335 service nova] Acquiring lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a093960d-5311-42c4-8fbd-7d5ba1eb1580 req-602ef643-eff3-4b60-ae61-825da5adf335 service nova] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a093960d-5311-42c4-8fbd-7d5ba1eb1580 req-602ef643-eff3-4b60-ae61-825da5adf335 service nova] Lock "f37b88a5-5935-4a36-8099-f21ebc27767d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-a093960d-5311-42c4-8fbd-7d5ba1eb1580 req-602ef643-eff3-4b60-ae61-825da5adf335 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] No waiting events found dispatching network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 09:59:21 user nova-compute[70374]: WARNING nova.compute.manager [req-a093960d-5311-42c4-8fbd-7d5ba1eb1580 req-602ef643-eff3-4b60-ae61-825da5adf335 service nova] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Received unexpected event network-vif-plugged-7caf0700-cf05-4bf1-9663-8ef0565f0002 for instance with vm_state deleted and task_state None.
Jul 27 09:59:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-28c50213-d22e-485f-b29d-0c289eeb3d80 req-e0a79ae7-4603-436b-98bc-534a52a346d2 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-28c50213-d22e-485f-b29d-0c289eeb3d80 req-e0a79ae7-4603-436b-98bc-534a52a346d2 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing instance network info cache due to event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-28c50213-d22e-485f-b29d-0c289eeb3d80 req-e0a79ae7-4603-436b-98bc-534a52a346d2 service nova] Acquiring lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-28c50213-d22e-485f-b29d-0c289eeb3d80 req-e0a79ae7-4603-436b-98bc-534a52a346d2 service nova] Acquired lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG nova.network.neutron [req-28c50213-d22e-485f-b29d-0c289eeb3d80 req-e0a79ae7-4603-436b-98bc-534a52a346d2 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG nova.network.neutron [req-28c50213-d22e-485f-b29d-0c289eeb3d80 req-e0a79ae7-4603-436b-98bc-534a52a346d2 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updated VIF entry in instance network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG nova.network.neutron [req-28c50213-d22e-485f-b29d-0c289eeb3d80 req-e0a79ae7-4603-436b-98bc-534a52a346d2 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:59:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-28c50213-d22e-485f-b29d-0c289eeb3d80 req-e0a79ae7-4603-436b-98bc-534a52a346d2 service nova] Releasing lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-1a671d72-de18-4a2a-a2eb-1c63850a5a73 req-6eb7c823-b754-4e37-86a2-f9718e1b0b49 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-1a671d72-de18-4a2a-a2eb-1c63850a5a73 req-6eb7c823-b754-4e37-86a2-f9718e1b0b49 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing instance network info cache due to event network-changed-f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1a671d72-de18-4a2a-a2eb-1c63850a5a73 req-6eb7c823-b754-4e37-86a2-f9718e1b0b49 service nova] Acquiring lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1a671d72-de18-4a2a-a2eb-1c63850a5a73 req-6eb7c823-b754-4e37-86a2-f9718e1b0b49 service nova] Acquired lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-1a671d72-de18-4a2a-a2eb-1c63850a5a73 req-6eb7c823-b754-4e37-86a2-f9718e1b0b49 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Refreshing network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:26 user nova-compute[70374]: INFO nova.compute.manager [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Detaching volume a7143456-482e-46f5-9936-2f39222245a6
Jul 27 09:59:26 user nova-compute[70374]: INFO nova.virt.block_device [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Attempting to driver detach volume a7143456-482e-46f5-9936-2f39222245a6 from mountpoint /dev/vdb
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Attempting to detach device vdb from instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:59:26 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:59:26 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:59:26 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:59:26 user nova-compute[70374]:   <serial>a7143456-482e-46f5-9936-2f39222245a6</serial>
Jul 27 09:59:26 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:59:26 user nova-compute[70374]: </disk>
Jul 27 09:59:26 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:59:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully detached device vdb from instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 from the persistent domain config.
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:59:26 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:59:26 user nova-compute[70374]:   <source dev="/dev/sdc"/>
Jul 27 09:59:26 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:59:26 user nova-compute[70374]:   <serial>a7143456-482e-46f5-9936-2f39222245a6</serial>
Jul 27 09:59:26 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:59:26 user nova-compute[70374]: </disk>
Jul 27 09:59:26 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-1a671d72-de18-4a2a-a2eb-1c63850a5a73 req-6eb7c823-b754-4e37-86a2-f9718e1b0b49 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updated VIF entry in instance network info cache for port f39e8958-b93d-4b15-8356-edb95877df4c. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-1a671d72-de18-4a2a-a2eb-1c63850a5a73 req-6eb7c823-b754-4e37-86a2-f9718e1b0b49 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [{"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1a671d72-de18-4a2a-a2eb-1c63850a5a73 req-6eb7c823-b754-4e37-86a2-f9718e1b0b49 service nova] Releasing lock "refresh_cache-708ed7e2-30d9-4a3f-85c8-55e74d98f233" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:26 user nova-compute[70374]: INFO nova.compute.manager [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Detaching volume d58bfe61-91c1-4978-b90a-1dbfb112830e
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451966.8960707, 708ed7e2-30d9-4a3f-85c8-55e74d98f233 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:59:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully detached device vdb from instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 from the live domain config.
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VItzWlpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:59:26 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d566c3d4-f6c8-4a15-8a9f-3e8101fb55cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:59:26 user nova-compute[70374]: No targets found.
Jul 27 09:59:26 user nova-compute[70374]: iSNS:
Jul 27 09:59:26 user nova-compute[70374]: No targets found.
Jul 27 09:59:26 user nova-compute[70374]: STATIC:
Jul 27 09:59:26 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6
Jul 27 09:59:26 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:59:26 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:59:26 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e
Jul 27 09:59:26 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:59:26 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:59:26 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 09:59:26 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:59:26 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:59:26 user nova-compute[70374]: FIRMWARE:
Jul 27 09:59:26 user nova-compute[70374]: No targets found.
Jul 27 09:59:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:59:26 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:59:26 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:26 user nova-compute[70374]: INFO nova.virt.block_device [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Attempting to driver detach volume d58bfe61-91c1-4978-b90a-1dbfb112830e from mountpoint /dev/vdb
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Attempting to detach device vdb from instance 70cea63a-70b3-405e-b654-8ea7f1126412 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:59:26 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:59:26 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:59:26 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:59:26 user nova-compute[70374]:   <serial>d58bfe61-91c1-4978-b90a-1dbfb112830e</serial>
Jul 27 09:59:26 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:59:26 user nova-compute[70374]: </disk>
Jul 27 09:59:26 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eba4c9-c601-4ac9-b6b6-8fe88e060f7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Successfully detached device vdb from instance 70cea63a-70b3-405e-b654-8ea7f1126412 from the persistent domain config.
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70cea63a-70b3-405e-b654-8ea7f1126412 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 09:59:26 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 09:59:26 user nova-compute[70374]:   <source dev="/dev/sde"/>
Jul 27 09:59:26 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 09:59:26 user nova-compute[70374]:   <serial>d58bfe61-91c1-4978-b90a-1dbfb112830e</serial>
Jul 27 09:59:26 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 09:59:26 user nova-compute[70374]: </disk>
Jul 27 09:59:26 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c1353-db37-4ffd-a4e1-a278f71a0a2a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:59:26 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:59:26 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:59:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:59:26 user nova-compute[70374]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 (non-flash)
Jul 27 09:59:26 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:59:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5d4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:59:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[468f0eda-aaf8-4af2-abb5-61169fd9033d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f148544a-24f8-43f1-aedf-10f8fb10a52d]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d6defb-9087-449a-b38d-2e8adfad3fcb]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae622163-db51-46bd-bc0a-187ac2c7aab7]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd88ae14-e2bf-4d59-8bad-b1a3460670b7]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebb339c-8448-4a30-a2d2-1137f27546f4]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6, portal: 172.16.0.220,3260]
Jul 27 09:59:27 user nova-compute[70374]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6, portal: 172.16.0.220,3260] successful.
Jul 27 09:59:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7143456-482e-46f5-9936-2f39222245a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cacfeba-444f-4c44-9689-dafb976a97f6]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] <== disconnect_volume: return (308ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690451967.392465, 70cea63a-70b3-405e-b654-8ea7f1126412 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 09:59:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Successfully detached device vdb from instance 70cea63a-70b3-405e-b654-8ea7f1126412 from the live domain config.
Jul 27 09:59:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBxnZDFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 09:59:27 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[869d2273-7840-4b75-ab5e-0f5b2b94d617]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 09:59:27 user nova-compute[70374]: No targets found.
Jul 27 09:59:27 user nova-compute[70374]: iSNS:
Jul 27 09:59:27 user nova-compute[70374]: No targets found.
Jul 27 09:59:27 user nova-compute[70374]: STATIC:
Jul 27 09:59:27 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e
Jul 27 09:59:27 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:59:27 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:59:27 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 09:59:27 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 09:59:27 user nova-compute[70374]:                 Iface Name: default
Jul 27 09:59:27 user nova-compute[70374]: FIRMWARE:
Jul 27 09:59:27 user nova-compute[70374]: No targets found.
Jul 27 09:59:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 09:59:27 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 09:59:27 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[124f016b-dd78-41ed-8934-094bd5779624]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68c386-a0e4-4f70-996a-753e50894fc2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:59:27 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:59:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 09:59:27 user nova-compute[70374]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e (non-flash)
Jul 27 09:59:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc459c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e'): ({'sde'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Removing single pathed devices sde {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[18081b16-ff23-412b-ac0a-16d97c30e3e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5308128-eff4-4569-a10b-456bdf9c7a1b]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Flushing IO for device /dev/sde {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[af107ff4-489a-4ace-b684-9a2e4907e7e3]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ec65b-f1e6-4c2c-ac8c-8a6f85a7b708]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abfba56-a239-4912-9df1-e8634b64d5c5]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8c2561-d94d-4544-a617-05581017b9fd]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e, portal: 172.16.0.220,3260]
Jul 27 09:59:27 user nova-compute[70374]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e, portal: 172.16.0.220,3260] successful.
Jul 27 09:59:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58bfe61-91c1-4978-b90a-1dbfb112830e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecd1175-638b-4c84-8c58-9d50145eee08]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] <== disconnect_volume: return (287ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 09:59:27 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'flavor' on Instance uuid 708ed7e2-30d9-4a3f-85c8-55e74d98f233 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:59:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d40bf37b-3bb7-4cb4-a9b4-707618bf2253 tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.663s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:28 user nova-compute[70374]: DEBUG nova.objects.instance [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'flavor' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 09:59:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-04561790-c870-406c-966c-bfe1efe723d7 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.565s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 09:59:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 09:59:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690451960.2893367, f37b88a5-5935-4a36-8099-f21ebc27767d => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 09:59:35 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] VM Stopped (Lifecycle Event)
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-893e22a6-b8ff-4614-86ce-e776c00bb8b2 None None] [instance: f37b88a5-5935-4a36-8099-f21ebc27767d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 09:59:35 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:59:35 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=25.12957000732422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 70cea63a-70b3-405e-b654-8ea7f1126412 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 09:59:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 09:59:36 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 09:59:36 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 09:59:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 09:59:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 09:59:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 09:59:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 09:59:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 09:59:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:59:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 09:59:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 09:59:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:00:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:00:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:00:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:17 user nova-compute[70374]: INFO nova.compute.manager [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Terminating instance
Jul 27 10:00:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-e72c4d3d-fb69-46a8-a19b-dd1739ba7bbd req-8434e6c8-8ff8-4ab4-aa95-8a1d8e2d0323 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-unplugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e72c4d3d-fb69-46a8-a19b-dd1739ba7bbd req-8434e6c8-8ff8-4ab4-aa95-8a1d8e2d0323 service nova] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e72c4d3d-fb69-46a8-a19b-dd1739ba7bbd req-8434e6c8-8ff8-4ab4-aa95-8a1d8e2d0323 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e72c4d3d-fb69-46a8-a19b-dd1739ba7bbd req-8434e6c8-8ff8-4ab4-aa95-8a1d8e2d0323 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-e72c4d3d-fb69-46a8-a19b-dd1739ba7bbd req-8434e6c8-8ff8-4ab4-aa95-8a1d8e2d0323 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] No waiting events found dispatching network-vif-unplugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-e72c4d3d-fb69-46a8-a19b-dd1739ba7bbd req-8434e6c8-8ff8-4ab4-aa95-8a1d8e2d0323 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-unplugged-7981eb37-eb74-45c4-98cd-42f9303161d0 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Instance destroyed successfully.
Jul 27 10:00:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lazy-loading 'resources' on Instance uuid 70cea63a-70b3-405e-b654-8ea7f1126412 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-511472426',display_name='tempest-TestServerVolumeAttachmentScenario-server-511472426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-511472426',id=41,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1Ow03Du3uPk9avJfrKojKqoIIF6MhGHlipNV0srogeB/cEh5zYwe5cdeZRz+LA7E3LvF4hfHJpuTgj67k8ex7R4CsHShbuAw/6aw+s65Nc3LsIkhsX4ldpMv/KfJnwVg==',key_name='tempest-keypair-93327628',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:56:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='638d25a4b11a4ddda2fb7b5775f8f396',ramdisk_id='',reservation_id='r-w2uipsn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1220688142',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1220688142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:56:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='127637a1ef10420881e9895927665f67',uuid=70cea63a-70b3-405e-b654-8ea7f1126412,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Converting VIF {"id": "7981eb37-eb74-45c4-98cd-42f9303161d0", "address": "fa:16:3e:34:a9:24", "network": {"id": "9baec0c8-d89b-4116-8bd2-d6d829d23505", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-97029025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "638d25a4b11a4ddda2fb7b5775f8f396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7981eb37-eb", "ovs_interfaceid": "7981eb37-eb74-45c4-98cd-42f9303161d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:a9:24,bridge_name='br-int',has_traffic_filtering=True,id=7981eb37-eb74-45c4-98cd-42f9303161d0,network=Network(9baec0c8-d89b-4116-8bd2-d6d829d23505),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7981eb37-eb') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG os_vif [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:a9:24,bridge_name='br-int',has_traffic_filtering=True,id=7981eb37-eb74-45c4-98cd-42f9303161d0,network=Network(9baec0c8-d89b-4116-8bd2-d6d829d23505),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7981eb37-eb') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7981eb37-eb, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:00:18 user nova-compute[70374]: INFO os_vif [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:a9:24,bridge_name='br-int',has_traffic_filtering=True,id=7981eb37-eb74-45c4-98cd-42f9303161d0,network=Network(9baec0c8-d89b-4116-8bd2-d6d829d23505),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7981eb37-eb')
Jul 27 10:00:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Deleting instance files /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412_del
Jul 27 10:00:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Deletion of /opt/stack/data/nova/instances/70cea63a-70b3-405e-b654-8ea7f1126412_del complete
Jul 27 10:00:18 user nova-compute[70374]: INFO nova.compute.manager [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 27 10:00:18 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:00:19 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Took 1.00 seconds to deallocate network for instance.
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-19d7106b-1c48-4684-a804-29faba38b066 req-02208d61-6bfe-4d70-b77b-61027e2a9246 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-deleted-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:19 user nova-compute[70374]: INFO nova.compute.manager [req-19d7106b-1c48-4684-a804-29faba38b066 req-02208d61-6bfe-4d70-b77b-61027e2a9246 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Neutron deleted interface 7981eb37-eb74-45c4-98cd-42f9303161d0; detaching it from the instance and deleting it from the info cache
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.network.neutron [req-19d7106b-1c48-4684-a804-29faba38b066 req-02208d61-6bfe-4d70-b77b-61027e2a9246 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-19d7106b-1c48-4684-a804-29faba38b066 req-02208d61-6bfe-4d70-b77b-61027e2a9246 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Detach interface failed, port_id=7981eb37-eb74-45c4-98cd-42f9303161d0, reason: Instance 70cea63a-70b3-405e-b654-8ea7f1126412 could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:19 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Deleted allocations for instance 70cea63a-70b3-405e-b654-8ea7f1126412
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] No waiting events found dispatching network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:19 user nova-compute[70374]: WARNING nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received unexpected event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 for instance with vm_state deleted and task_state None.
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] No waiting events found dispatching network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:19 user nova-compute[70374]: WARNING nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received unexpected event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 for instance with vm_state deleted and task_state None.
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] No waiting events found dispatching network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:19 user nova-compute[70374]: WARNING nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received unexpected event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 for instance with vm_state deleted and task_state None.
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Acquiring lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] Lock "70cea63a-70b3-405e-b654-8ea7f1126412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] No waiting events found dispatching network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:19 user nova-compute[70374]: WARNING nova.compute.manager [req-36f06d80-125c-48e2-9e55-24e546f4d843 req-1d81adc4-60db-4ec6-a279-d35d12989a85 service nova] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Received unexpected event network-vif-plugged-7981eb37-eb74-45c4-98cd-42f9303161d0 for instance with vm_state deleted and task_state None.
Jul 27 10:00:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-59fd8031-727c-40cb-821f-a9b73c5df6c8 tempest-TestServerVolumeAttachmentScenario-1220688142 tempest-TestServerVolumeAttachmentScenario-1220688142-project-member] Lock "70cea63a-70b3-405e-b654-8ea7f1126412" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:26 user nova-compute[70374]: INFO nova.compute.manager [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Terminating instance
Jul 27 10:00:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-7439d8dc-73eb-4a93-bc0d-f073a79959b6 req-01777593-4319-412a-9c2c-b048ddfb0043 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-unplugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7439d8dc-73eb-4a93-bc0d-f073a79959b6 req-01777593-4319-412a-9c2c-b048ddfb0043 service nova] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7439d8dc-73eb-4a93-bc0d-f073a79959b6 req-01777593-4319-412a-9c2c-b048ddfb0043 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7439d8dc-73eb-4a93-bc0d-f073a79959b6 req-01777593-4319-412a-9c2c-b048ddfb0043 service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-7439d8dc-73eb-4a93-bc0d-f073a79959b6 req-01777593-4319-412a-9c2c-b048ddfb0043 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] No waiting events found dispatching network-vif-unplugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-7439d8dc-73eb-4a93-bc0d-f073a79959b6 req-01777593-4319-412a-9c2c-b048ddfb0043 service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-unplugged-f39e8958-b93d-4b15-8356-edb95877df4c for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:00:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Instance destroyed successfully.
Jul 27 10:00:27 user nova-compute[70374]: DEBUG nova.objects.instance [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lazy-loading 'resources' on Instance uuid 708ed7e2-30d9-4a3f-85c8-55e74d98f233 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1885489661',display_name='tempest-TestMinimumBasicScenario-server-1885489661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1885489661',id=39,image_ref='628d0979-639d-4c79-9595-e49dfadbae4a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzhVyGBZNYtgons3fvGQKB7nVm5zbm6PM105hOB4uC3OrY3ps/Hqs9avyTkdVT3/z0PX00DmMc3YDwmaCMERlG+23gBUEgTeJfwgCrVzQu0EWKp2upfTIFekkeZZRAU3g==',key_name='tempest-TestMinimumBasicScenario-1260725173',keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec51f550eb3b4bd8883b2242eb2905f7',ramdisk_id='',reservation_id='r-xfqqzprr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='628d0979-639d-4c79-9595-e49dfadbae4a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1439165130',owner_user_name='tempest-TestMinimumBasicScenario-1439165130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:57:41Z,user_data=None,user_id='229f3686d8184688b3ced860a5d7b07e',uuid=708ed7e2-30d9-4a3f-85c8-55e74d98f233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converting VIF {"id": "f39e8958-b93d-4b15-8356-edb95877df4c", "address": "fa:16:3e:43:4f:51", "network": {"id": "1981858f-c21e-4939-95dd-0aabdf973d7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2066391976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec51f550eb3b4bd8883b2242eb2905f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39e8958-b9", "ovs_interfaceid": "f39e8958-b93d-4b15-8356-edb95877df4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:4f:51,bridge_name='br-int',has_traffic_filtering=True,id=f39e8958-b93d-4b15-8356-edb95877df4c,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39e8958-b9') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG os_vif [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:4f:51,bridge_name='br-int',has_traffic_filtering=True,id=f39e8958-b93d-4b15-8356-edb95877df4c,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39e8958-b9') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf39e8958-b9, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:00:27 user nova-compute[70374]: INFO os_vif [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:4f:51,bridge_name='br-int',has_traffic_filtering=True,id=f39e8958-b93d-4b15-8356-edb95877df4c,network=Network(1981858f-c21e-4939-95dd-0aabdf973d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39e8958-b9')
Jul 27 10:00:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Deleting instance files /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233_del
Jul 27 10:00:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Deletion of /opt/stack/data/nova/instances/708ed7e2-30d9-4a3f-85c8-55e74d98f233_del complete
Jul 27 10:00:27 user nova-compute[70374]: INFO nova.compute.manager [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 27 10:00:27 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:00:27 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Took 0.64 seconds to deallocate network for instance.
Jul 27 10:00:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:27 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:00:28 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:00:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:28 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Deleted allocations for instance 708ed7e2-30d9-4a3f-85c8-55e74d98f233
Jul 27 10:00:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-ba990b74-cc72-4c03-9420-831c132bdbfc tempest-TestMinimumBasicScenario-1439165130 tempest-TestMinimumBasicScenario-1439165130-project-member] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.814s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-523ef725-0d74-471e-86df-c0b507081794 req-b0fb708f-a503-4524-b0b4-29397794690a service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-523ef725-0d74-471e-86df-c0b507081794 req-b0fb708f-a503-4524-b0b4-29397794690a service nova] Acquiring lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-523ef725-0d74-471e-86df-c0b507081794 req-b0fb708f-a503-4524-b0b4-29397794690a service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-523ef725-0d74-471e-86df-c0b507081794 req-b0fb708f-a503-4524-b0b4-29397794690a service nova] Lock "708ed7e2-30d9-4a3f-85c8-55e74d98f233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-523ef725-0d74-471e-86df-c0b507081794 req-b0fb708f-a503-4524-b0b4-29397794690a service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] No waiting events found dispatching network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:28 user nova-compute[70374]: WARNING nova.compute.manager [req-523ef725-0d74-471e-86df-c0b507081794 req-b0fb708f-a503-4524-b0b4-29397794690a service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received unexpected event network-vif-plugged-f39e8958-b93d-4b15-8356-edb95877df4c for instance with vm_state deleted and task_state None.
Jul 27 10:00:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-523ef725-0d74-471e-86df-c0b507081794 req-b0fb708f-a503-4524-b0b4-29397794690a service nova] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Received event network-vif-deleted-f39e8958-b93d-4b15-8356-edb95877df4c {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:00:29 user nova-compute[70374]: INFO nova.compute.claims [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Claim successful on node user
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Skipping network cache update for instance because it is Building. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.network.neutron [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:00:29 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.policy [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '653bb45e82be4371b55519bbf5308711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15442b359a014219b7854237eaaad0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:00:29 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Creating image(s)
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "/opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "/opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "/opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.143s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:00:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk 1073741824" returned: 0 in 0.056s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.147s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG nova.network.neutron [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Successfully created port: 818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Cannot resize image /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG nova.objects.instance [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'migration_context' on Instance uuid 06b6cb39-6667-4b3e-ba46-ecee8137ab90 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Ensure instance console log exists: /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Successfully updated port: 818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquired lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-5741005a-4fe4-4b88-a02b-07c7bf1c2b0b req-9f2bd18c-6001-42d1-8cf7-8a857c0b2576 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-changed-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-5741005a-4fe4-4b88-a02b-07c7bf1c2b0b req-9f2bd18c-6001-42d1-8cf7-8a857c0b2576 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Refreshing instance network info cache due to event network-changed-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5741005a-4fe4-4b88-a02b-07c7bf1c2b0b req-9f2bd18c-6001-42d1-8cf7-8a857c0b2576 service nova] Acquiring lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Updating instance_info_cache with network_info: [{"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Releasing lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Instance network_info: |[{"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5741005a-4fe4-4b88-a02b-07c7bf1c2b0b req-9f2bd18c-6001-42d1-8cf7-8a857c0b2576 service nova] Acquired lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.neutron [req-5741005a-4fe4-4b88-a02b-07c7bf1c2b0b req-9f2bd18c-6001-42d1-8cf7-8a857c0b2576 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Refreshing network info cache for port 818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Start _get_guest_xml network_info=[{"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:00:31 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:00:31 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1640255479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1640255479',id=42,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-u8src55d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:00:30Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=06b6cb39-6667-4b3e-ba46-ecee8137ab90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e3:94,bridge_name='br-int',has_traffic_filtering=True,id=818f27e3-bad0-4a0b-9af1-32bd4da1c1c4,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f27e3-ba') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.objects.instance [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'pci_devices' on Instance uuid 06b6cb39-6667-4b3e-ba46-ecee8137ab90 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:00:31 user nova-compute[70374]:   <uuid>06b6cb39-6667-4b3e-ba46-ecee8137ab90</uuid>
Jul 27 10:00:31 user nova-compute[70374]:   <name>instance-0000002a</name>
Jul 27 10:00:31 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:00:31 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:00:31 user nova-compute[70374]:   <metadata>
Jul 27 10:00:31 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:00:31 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:00:31 user nova-compute[70374]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1640255479</nova:name>
Jul 27 10:00:31 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:00:31</nova:creationTime>
Jul 27 10:00:31 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:00:31 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:00:31 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:00:31 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:00:31 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:00:31 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:00:31 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:00:31 user nova-compute[70374]:       <nova:owner>
Jul 27 10:00:31 user nova-compute[70374]:         <nova:user uuid="653bb45e82be4371b55519bbf5308711">tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member</nova:user>
Jul 27 10:00:31 user nova-compute[70374]:         <nova:project uuid="15442b359a014219b7854237eaaad0d3">tempest-ServerBootFromVolumeStableRescueTest-1815884142</nova:project>
Jul 27 10:00:31 user nova-compute[70374]:       </nova:owner>
Jul 27 10:00:31 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 10:00:31 user nova-compute[70374]:       <nova:ports>
Jul 27 10:00:31 user nova-compute[70374]:         <nova:port uuid="818f27e3-bad0-4a0b-9af1-32bd4da1c1c4">
Jul 27 10:00:31 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 10:00:31 user nova-compute[70374]:         </nova:port>
Jul 27 10:00:31 user nova-compute[70374]:       </nova:ports>
Jul 27 10:00:31 user nova-compute[70374]:     </nova:instance>
Jul 27 10:00:31 user nova-compute[70374]:   </metadata>
Jul 27 10:00:31 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:00:31 user nova-compute[70374]:     <system>
Jul 27 10:00:31 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:00:31 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:00:31 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:00:31 user nova-compute[70374]:       <entry name="serial">06b6cb39-6667-4b3e-ba46-ecee8137ab90</entry>
Jul 27 10:00:31 user nova-compute[70374]:       <entry name="uuid">06b6cb39-6667-4b3e-ba46-ecee8137ab90</entry>
Jul 27 10:00:31 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:00:31 user nova-compute[70374]:     </system>
Jul 27 10:00:31 user nova-compute[70374]:   </sysinfo>
Jul 27 10:00:31 user nova-compute[70374]:   <os>
Jul 27 10:00:31 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:00:31 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:00:31 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:00:31 user nova-compute[70374]:   </os>
Jul 27 10:00:31 user nova-compute[70374]:   <features>
Jul 27 10:00:31 user nova-compute[70374]:     <acpi/>
Jul 27 10:00:31 user nova-compute[70374]:     <apic/>
Jul 27 10:00:31 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:00:31 user nova-compute[70374]:   </features>
Jul 27 10:00:31 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:00:31 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:00:31 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:00:31 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:00:31 user nova-compute[70374]:   </clock>
Jul 27 10:00:31 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:00:31 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:00:31 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:00:31 user nova-compute[70374]:   </cpu>
Jul 27 10:00:31 user nova-compute[70374]:   <devices>
Jul 27 10:00:31 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 10:00:31 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 10:00:31 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk"/>
Jul 27 10:00:31 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:00:31 user nova-compute[70374]:     </disk>
Jul 27 10:00:31 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:00:31 user nova-compute[70374]:       <mac address="fa:16:3e:1e:e3:94"/>
Jul 27 10:00:31 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:00:31 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:00:31 user nova-compute[70374]:       <target dev="tap818f27e3-ba"/>
Jul 27 10:00:31 user nova-compute[70374]:     </interface>
Jul 27 10:00:31 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:00:31 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/console.log" append="off"/>
Jul 27 10:00:31 user nova-compute[70374]:     </serial>
Jul 27 10:00:31 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:00:31 user nova-compute[70374]:     <video>
Jul 27 10:00:31 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:00:31 user nova-compute[70374]:     </video>
Jul 27 10:00:31 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:00:31 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:00:31 user nova-compute[70374]:     </rng>
Jul 27 10:00:31 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:00:31 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:00:31 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:00:31 user nova-compute[70374]:     </memballoon>
Jul 27 10:00:31 user nova-compute[70374]:   </devices>
Jul 27 10:00:31 user nova-compute[70374]: </domain>
Jul 27 10:00:31 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1640255479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1640255479',id=42,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-u8src55d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:00:30Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=06b6cb39-6667-4b3e-ba46-ecee8137ab90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e3:94,bridge_name='br-int',has_traffic_filtering=True,id=818f27e3-bad0-4a0b-9af1-32bd4da1c1c4,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f27e3-ba') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG os_vif [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e3:94,bridge_name='br-int',has_traffic_filtering=True,id=818f27e3-bad0-4a0b-9af1-32bd4da1c1c4,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f27e3-ba') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap818f27e3-ba, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap818f27e3-ba, col_values=(('external_ids', {'iface-id': '818f27e3-bad0-4a0b-9af1-32bd4da1c1c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:e3:94', 'vm-uuid': '06b6cb39-6667-4b3e-ba46-ecee8137ab90'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:31 user nova-compute[70374]: INFO os_vif [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e3:94,bridge_name='br-int',has_traffic_filtering=True,id=818f27e3-bad0-4a0b-9af1-32bd4da1c1c4,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f27e3-ba')
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:00:31 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No VIF found with MAC fa:16:3e:1e:e3:94, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:00:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-5741005a-4fe4-4b88-a02b-07c7bf1c2b0b req-9f2bd18c-6001-42d1-8cf7-8a857c0b2576 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Updated VIF entry in instance network info cache for port 818f27e3-bad0-4a0b-9af1-32bd4da1c1c4. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:00:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-5741005a-4fe4-4b88-a02b-07c7bf1c2b0b req-9f2bd18c-6001-42d1-8cf7-8a857c0b2576 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Updating instance_info_cache with network_info: [{"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:00:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5741005a-4fe4-4b88-a02b-07c7bf1c2b0b req-9f2bd18c-6001-42d1-8cf7-8a857c0b2576 service nova] Releasing lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452018.0599668, 70cea63a-70b3-405e-b654-8ea7f1126412 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:00:33 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] VM Stopped (Lifecycle Event)
Jul 27 10:00:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-306c9bb4-5439-4811-9fde-eb298f18f9c7 None None] [instance: 70cea63a-70b3-405e-b654-8ea7f1126412] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-f8fab609-f0e1-4641-8eb3-e14f1d15d5b8 req-9a9b6eb0-8def-433a-9eb4-a86df5cc744d service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f8fab609-f0e1-4641-8eb3-e14f1d15d5b8 req-9a9b6eb0-8def-433a-9eb4-a86df5cc744d service nova] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f8fab609-f0e1-4641-8eb3-e14f1d15d5b8 req-9a9b6eb0-8def-433a-9eb4-a86df5cc744d service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f8fab609-f0e1-4641-8eb3-e14f1d15d5b8 req-9a9b6eb0-8def-433a-9eb4-a86df5cc744d service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-f8fab609-f0e1-4641-8eb3-e14f1d15d5b8 req-9a9b6eb0-8def-433a-9eb4-a86df5cc744d service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] No waiting events found dispatching network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:33 user nova-compute[70374]: WARNING nova.compute.manager [req-f8fab609-f0e1-4641-8eb3-e14f1d15d5b8 req-9a9b6eb0-8def-433a-9eb4-a86df5cc744d service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received unexpected event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 for instance with vm_state building and task_state spawning.
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452035.3101268, 06b6cb39-6667-4b3e-ba46-ecee8137ab90 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:00:35 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] VM Resumed (Lifecycle Event)
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Instance spawned successfully.
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:00:35 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452035.3113668, 06b6cb39-6667-4b3e-ba46-ecee8137ab90 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:00:35 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] VM Started (Lifecycle Event)
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:00:35 user nova-compute[70374]: INFO nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Took 5.72 seconds to spawn the instance on the hypervisor.
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:00:35 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:00:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-e5bc937e-1ab7-4cb1-9d15-b1a8783224a5 req-25d45710-6335-4489-ab39-887491b190d7 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e5bc937e-1ab7-4cb1-9d15-b1a8783224a5 req-25d45710-6335-4489-ab39-887491b190d7 service nova] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e5bc937e-1ab7-4cb1-9d15-b1a8783224a5 req-25d45710-6335-4489-ab39-887491b190d7 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e5bc937e-1ab7-4cb1-9d15-b1a8783224a5 req-25d45710-6335-4489-ab39-887491b190d7 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-e5bc937e-1ab7-4cb1-9d15-b1a8783224a5 req-25d45710-6335-4489-ab39-887491b190d7 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] No waiting events found dispatching network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:00:35 user nova-compute[70374]: WARNING nova.compute.manager [req-e5bc937e-1ab7-4cb1-9d15-b1a8783224a5 req-25d45710-6335-4489-ab39-887491b190d7 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received unexpected event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 for instance with vm_state building and task_state spawning.
Jul 27 10:00:35 user nova-compute[70374]: INFO nova.compute.manager [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Took 6.36 seconds to build instance.
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-05a791a6-aa93-40df-9302-4a5fb2ef68ef tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.451s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:00:36 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:00:36 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:00:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=25.18280792236328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:00:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:37 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:00:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:00:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:00:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:00:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:42 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452027.09852, 708ed7e2-30d9-4a3f-85c8-55e74d98f233 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:00:42 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] VM Stopped (Lifecycle Event)
Jul 27 10:00:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0811dc7b-dd29-4fe2-9eb1-16b975f0c77f None None] [instance: 708ed7e2-30d9-4a3f-85c8-55e74d98f233] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:00:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:53 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:00:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:00:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:01:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:31 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:01:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:01:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:01:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:01:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:32 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:01:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:01:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:01:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:01:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:36 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:01:36 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:01:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=25.184585571289062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:01:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:01:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:01:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 10:01:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 10:01:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 10:01:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "3afa9363-b190-49d2-a05b-95863a58ac9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:01:50 user nova-compute[70374]: INFO nova.compute.claims [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Claim successful on node user
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:01:50 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:01:50 user nova-compute[70374]: INFO nova.virt.block_device [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Booting with volume snapshot 5cb01d93-799c-4a67-9b1e-3e5fb274c263 at /dev/vda
Jul 27 10:01:50 user nova-compute[70374]: DEBUG nova.policy [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6e02625621443392a958dd87d679a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e1ff0e178842deba4c0efce3b84cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:01:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Successfully created port: 76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:01:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:01:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:01:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:01:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:01:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Successfully updated port: 76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "refresh_cache-3afa9363-b190-49d2-a05b-95863a58ac9f" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquired lock "refresh_cache-3afa9363-b190-49d2-a05b-95863a58ac9f" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-0f3646f7-c3ea-43c2-b8b4-73e6ed00078b req-b39db3f1-7850-48be-9741-54cde13a2d4a service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received event network-changed-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-0f3646f7-c3ea-43c2-b8b4-73e6ed00078b req-b39db3f1-7850-48be-9741-54cde13a2d4a service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Refreshing instance network info cache due to event network-changed-76eadb21-7733-49c9-8614-76246a2277ed. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0f3646f7-c3ea-43c2-b8b4-73e6ed00078b req-b39db3f1-7850-48be-9741-54cde13a2d4a service nova] Acquiring lock "refresh_cache-3afa9363-b190-49d2-a05b-95863a58ac9f" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Updating instance_info_cache with network_info: [{"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Releasing lock "refresh_cache-3afa9363-b190-49d2-a05b-95863a58ac9f" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Instance network_info: |[{"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0f3646f7-c3ea-43c2-b8b4-73e6ed00078b req-b39db3f1-7850-48be-9741-54cde13a2d4a service nova] Acquired lock "refresh_cache-3afa9363-b190-49d2-a05b-95863a58ac9f" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-0f3646f7-c3ea-43c2-b8b4-73e6ed00078b req-b39db3f1-7850-48be-9741-54cde13a2d4a service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Refreshing network info cache for port 76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-0f3646f7-c3ea-43c2-b8b4-73e6ed00078b req-b39db3f1-7850-48be-9741-54cde13a2d4a service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Updated VIF entry in instance network info cache for port 76eadb21-7733-49c9-8614-76246a2277ed. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-0f3646f7-c3ea-43c2-b8b4-73e6ed00078b req-b39db3f1-7850-48be-9741-54cde13a2d4a service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Updating instance_info_cache with network_info: [{"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:01:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0f3646f7-c3ea-43c2-b8b4-73e6ed00078b req-b39db3f1-7850-48be-9741-54cde13a2d4a service nova] Releasing lock "refresh_cache-3afa9363-b190-49d2-a05b-95863a58ac9f" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:01:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG os_brick.utils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[029eeeb7-1ada-4774-b330-d08917e3913d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[68049aad-b309-4740-8104-53bb797862a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd8195-618c-411d-b11d-c3792ad78142]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[04168c8b-5934-4969-a0a4-a9238c198b91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:01:56 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:01:56 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b37eb-42cf-40e9-a85e-d9dfb012aacd]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG os_brick.utils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Updating existing volume attachment record: e2a02a1e-4012-49dc-b22c-4a8b6b0e655d {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:01:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:02:03 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Creating image(s)
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Ensure instance console log exists: /opt/stack/data/nova/instances/3afa9363-b190-49d2-a05b-95863a58ac9f/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Start _get_guest_xml network_info=[{"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'e2a02a1e-4012-49dc-b22c-4a8b6b0e655d', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKwBUniQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3afa9363-b190-49d2-a05b-95863a58ac9f', 'attached_at': '', 'detached_at': '', 'volume_id': '35297fe9-208e-41b9-bb66-a8e999c72edc', 'serial': '35297fe9-208e-41b9-bb66-a8e999c72edc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:02:03 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:02:03 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKwBUniQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:02:03 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:02:03 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:02:03 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efe2b6f-3ef8-46a3-89a3-2404c2e1cb13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:02:03 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ad017-a0ad-482d-9402-6a402c61c7bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc] added
Jul 27 10:02:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fa1f19-a60a-457a-8002-11684c1b8f1c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae9cad5-c305-4eab-84c6-bf387287e3e3]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hKwBUniQ {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hKwBUniQ" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9072f506-ef59-47fb-b52e-5e1f7ff7fc05]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hKwBUniQ'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[de613690-b269-4e3b-abb1-cd45d6c1e9b8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46abb7-c4e6-431f-8d84-474d8868916d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:02:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:02:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0264d0-63ab-4b49-9d1a-ec54a9ed4f45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc, portal: 172.16.0.220,3260]
Jul 27 10:02:03 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc, portal: 172.16.0.220,3260] successful.
Jul 27 10:02:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[24981565-6bcb-43d6-a238-3eb7dfbe1d9b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[431628fd-1c16-4b22-bafc-f15af828d27f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:02:03 user nova-compute[70374]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)
Jul 27 10:02:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:02:03 user nova-compute[70374]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)
Jul 27 10:02:03 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b60cae0-bce2-4808-bd3c-ed2634c8beb0]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:02:03 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKwBUniQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23836346538623737', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836346538623737', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1101838999',display_name='tempest-TestVolumeBootPattern-server-1101838999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1101838999',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-c3qkclen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:01:51Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=3afa9363-b190-49d2-a05b-95863a58ac9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=76eadb21-7733-49c9-8614-76246a2277ed,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76eadb21-77') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.objects.instance [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'pci_devices' on Instance uuid 3afa9363-b190-49d2-a05b-95863a58ac9f {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:02:04 user nova-compute[70374]:   <uuid>3afa9363-b190-49d2-a05b-95863a58ac9f</uuid>
Jul 27 10:02:04 user nova-compute[70374]:   <name>instance-0000002b</name>
Jul 27 10:02:04 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:02:04 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:02:04 user nova-compute[70374]:   <metadata>
Jul 27 10:02:04 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:02:04 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:02:04 user nova-compute[70374]:       <nova:name>tempest-TestVolumeBootPattern-server-1101838999</nova:name>
Jul 27 10:02:04 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:02:03</nova:creationTime>
Jul 27 10:02:04 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:02:04 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:02:04 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:02:04 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:02:04 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:02:04 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:02:04 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:02:04 user nova-compute[70374]:       <nova:owner>
Jul 27 10:02:04 user nova-compute[70374]:         <nova:user uuid="fc6e02625621443392a958dd87d679a3">tempest-TestVolumeBootPattern-953954878-project-member</nova:user>
Jul 27 10:02:04 user nova-compute[70374]:         <nova:project uuid="52e1ff0e178842deba4c0efce3b84cf8">tempest-TestVolumeBootPattern-953954878</nova:project>
Jul 27 10:02:04 user nova-compute[70374]:       </nova:owner>
Jul 27 10:02:04 user nova-compute[70374]:       <nova:ports>
Jul 27 10:02:04 user nova-compute[70374]:         <nova:port uuid="76eadb21-7733-49c9-8614-76246a2277ed">
Jul 27 10:02:04 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 10:02:04 user nova-compute[70374]:         </nova:port>
Jul 27 10:02:04 user nova-compute[70374]:       </nova:ports>
Jul 27 10:02:04 user nova-compute[70374]:     </nova:instance>
Jul 27 10:02:04 user nova-compute[70374]:   </metadata>
Jul 27 10:02:04 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:02:04 user nova-compute[70374]:     <system>
Jul 27 10:02:04 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:02:04 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:02:04 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:02:04 user nova-compute[70374]:       <entry name="serial">3afa9363-b190-49d2-a05b-95863a58ac9f</entry>
Jul 27 10:02:04 user nova-compute[70374]:       <entry name="uuid">3afa9363-b190-49d2-a05b-95863a58ac9f</entry>
Jul 27 10:02:04 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:02:04 user nova-compute[70374]:     </system>
Jul 27 10:02:04 user nova-compute[70374]:   </sysinfo>
Jul 27 10:02:04 user nova-compute[70374]:   <os>
Jul 27 10:02:04 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:02:04 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:02:04 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:02:04 user nova-compute[70374]:   </os>
Jul 27 10:02:04 user nova-compute[70374]:   <features>
Jul 27 10:02:04 user nova-compute[70374]:     <acpi/>
Jul 27 10:02:04 user nova-compute[70374]:     <apic/>
Jul 27 10:02:04 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:02:04 user nova-compute[70374]:   </features>
Jul 27 10:02:04 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:02:04 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:02:04 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:02:04 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:02:04 user nova-compute[70374]:   </clock>
Jul 27 10:02:04 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:02:04 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:02:04 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:02:04 user nova-compute[70374]:   </cpu>
Jul 27 10:02:04 user nova-compute[70374]:   <devices>
Jul 27 10:02:04 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:02:04 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:02:04 user nova-compute[70374]:       <source dev="/dev/sdc"/>
Jul 27 10:02:04 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:02:04 user nova-compute[70374]:       <serial>35297fe9-208e-41b9-bb66-a8e999c72edc</serial>
Jul 27 10:02:04 user nova-compute[70374]:     </disk>
Jul 27 10:02:04 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:02:04 user nova-compute[70374]:       <mac address="fa:16:3e:3c:a0:f3"/>
Jul 27 10:02:04 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:02:04 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:02:04 user nova-compute[70374]:       <target dev="tap76eadb21-77"/>
Jul 27 10:02:04 user nova-compute[70374]:     </interface>
Jul 27 10:02:04 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:02:04 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/3afa9363-b190-49d2-a05b-95863a58ac9f/console.log" append="off"/>
Jul 27 10:02:04 user nova-compute[70374]:     </serial>
Jul 27 10:02:04 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:02:04 user nova-compute[70374]:     <video>
Jul 27 10:02:04 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:02:04 user nova-compute[70374]:     </video>
Jul 27 10:02:04 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:02:04 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:02:04 user nova-compute[70374]:     </rng>
Jul 27 10:02:04 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:02:04 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:02:04 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:02:04 user nova-compute[70374]:     </memballoon>
Jul 27 10:02:04 user nova-compute[70374]:   </devices>
Jul 27 10:02:04 user nova-compute[70374]: </domain>
Jul 27 10:02:04 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1101838999',display_name='tempest-TestVolumeBootPattern-server-1101838999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1101838999',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-c3qkclen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:01:51Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=3afa9363-b190-49d2-a05b-95863a58ac9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=76eadb21-7733-49c9-8614-76246a2277ed,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76eadb21-77') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG os_vif [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=76eadb21-7733-49c9-8614-76246a2277ed,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76eadb21-77') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76eadb21-77, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76eadb21-77, col_values=(('external_ids', {'iface-id': '76eadb21-7733-49c9-8614-76246a2277ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:a0:f3', 'vm-uuid': '3afa9363-b190-49d2-a05b-95863a58ac9f'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:04 user nova-compute[70374]: INFO os_vif [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=76eadb21-7733-49c9-8614-76246a2277ed,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76eadb21-77')
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:02:04 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No VIF found with MAC fa:16:3e:3c:a0:f3, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:02:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-7e0efb08-657a-4d8f-91c3-89916cc68c3b req-190612f3-3934-487e-94b6-4923c922d53c service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received event network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:02:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7e0efb08-657a-4d8f-91c3-89916cc68c3b req-190612f3-3934-487e-94b6-4923c922d53c service nova] Acquiring lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:02:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7e0efb08-657a-4d8f-91c3-89916cc68c3b req-190612f3-3934-487e-94b6-4923c922d53c service nova] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:02:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7e0efb08-657a-4d8f-91c3-89916cc68c3b req-190612f3-3934-487e-94b6-4923c922d53c service nova] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:02:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-7e0efb08-657a-4d8f-91c3-89916cc68c3b req-190612f3-3934-487e-94b6-4923c922d53c service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] No waiting events found dispatching network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:02:06 user nova-compute[70374]: WARNING nova.compute.manager [req-7e0efb08-657a-4d8f-91c3-89916cc68c3b req-190612f3-3934-487e-94b6-4923c922d53c service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received unexpected event network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed for instance with vm_state building and task_state spawning.
Jul 27 10:02:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452127.9242232, 3afa9363-b190-49d2-a05b-95863a58ac9f => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:02:07 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] VM Resumed (Lifecycle Event)
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:02:07 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Instance spawned successfully.
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:02:07 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452127.9278412, 3afa9363-b190-49d2-a05b-95863a58ac9f => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:02:07 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] VM Started (Lifecycle Event)
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:02:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:02:08 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:02:08 user nova-compute[70374]: INFO nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Took 4.92 seconds to spawn the instance on the hypervisor.
Jul 27 10:02:08 user nova-compute[70374]: DEBUG nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:02:08 user nova-compute[70374]: INFO nova.compute.manager [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Took 17.66 seconds to build instance.
Jul 27 10:02:08 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba03baee-48ae-49a2-b8d5-c7bd0ed96584 req-11fae4d0-8d34-4506-ba8e-2db801894f5b service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received event network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:02:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba03baee-48ae-49a2-b8d5-c7bd0ed96584 req-11fae4d0-8d34-4506-ba8e-2db801894f5b service nova] Acquiring lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:02:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba03baee-48ae-49a2-b8d5-c7bd0ed96584 req-11fae4d0-8d34-4506-ba8e-2db801894f5b service nova] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:02:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ba03baee-48ae-49a2-b8d5-c7bd0ed96584 req-11fae4d0-8d34-4506-ba8e-2db801894f5b service nova] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:02:08 user nova-compute[70374]: DEBUG nova.compute.manager [req-ba03baee-48ae-49a2-b8d5-c7bd0ed96584 req-11fae4d0-8d34-4506-ba8e-2db801894f5b service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] No waiting events found dispatching network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:02:08 user nova-compute[70374]: WARNING nova.compute.manager [req-ba03baee-48ae-49a2-b8d5-c7bd0ed96584 req-11fae4d0-8d34-4506-ba8e-2db801894f5b service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received unexpected event network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed for instance with vm_state active and task_state None.
Jul 27 10:02:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-995ff50b-96ba-4392-8cbc-079f4107b954 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.765s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:02:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:02:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:02:20 user nova-compute[70374]: INFO nova.compute.manager [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] instance snapshotting
Jul 27 10:02:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Beginning live snapshot process
Jul 27 10:02:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json -f qcow2 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json -f qcow2 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8k5fn1rl/a112eac3d5af4dd4958733cca70dbc49.delta 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8k5fn1rl/a112eac3d5af4dd4958733cca70dbc49.delta 1073741824" returned: 0 in 0.056s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:21 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 10:02:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 10:02:22 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70374) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 10:02:22 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 10:02:22 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 10:02:22 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8k5fn1rl/a112eac3d5af4dd4958733cca70dbc49.delta /opt/stack/data/nova/instances/snapshots/tmp8k5fn1rl/a112eac3d5af4dd4958733cca70dbc49 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:23 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8k5fn1rl/a112eac3d5af4dd4958733cca70dbc49.delta /opt/stack/data/nova/instances/snapshots/tmp8k5fn1rl/a112eac3d5af4dd4958733cca70dbc49" returned: 0 in 0.360s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:23 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Snapshot extracted, beginning image upload
Jul 27 10:02:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:02:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:25 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Snapshot image upload complete
Jul 27 10:02:25 user nova-compute[70374]: INFO nova.compute.manager [None req-f555f503-bb30-444f-bef1-5156fd75200c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Took 4.96 seconds to snapshot the instance on the hypervisor.
Jul 27 10:02:26 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:29 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:02:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:31 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:02:37 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:02:37 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8515MB free_disk=25.133296966552734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 3afa9363-b190-49d2-a05b-95863a58ac9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:02:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:02:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:39 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:02:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:02:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:02:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:03:27 user nova-compute[70374]: INFO nova.compute.claims [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Claim successful on node user
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.network.neutron [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:03:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:03:27 user nova-compute[70374]: INFO nova.virt.block_device [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Booting with volume-backed-image 35458adf-261a-4e0b-a4db-b243619b2394 at /dev/vda
Jul 27 10:03:27 user nova-compute[70374]: DEBUG nova.policy [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '653bb45e82be4371b55519bbf5308711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15442b359a014219b7854237eaaad0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:03:28 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:28 user nova-compute[70374]: DEBUG nova.network.neutron [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Successfully created port: b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG nova.network.neutron [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Successfully updated port: b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquired lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG nova.network.neutron [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG nova.network.neutron [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-0448812f-aea4-49fe-a7a5-a9efb8ec2346 req-4d7dfedf-5d04-4eb1-8941-815f47d8fae1 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-changed-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG nova.compute.manager [req-0448812f-aea4-49fe-a7a5-a9efb8ec2346 req-4d7dfedf-5d04-4eb1-8941-815f47d8fae1 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Refreshing instance network info cache due to event network-changed-b04dafcc-e150-43c9-b4ad-82843e7d8802. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:03:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0448812f-aea4-49fe-a7a5-a9efb8ec2346 req-4d7dfedf-5d04-4eb1-8941-815f47d8fae1 service nova] Acquiring lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG nova.network.neutron [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Updating instance_info_cache with network_info: [{"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Releasing lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance network_info: |[{"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0448812f-aea4-49fe-a7a5-a9efb8ec2346 req-4d7dfedf-5d04-4eb1-8941-815f47d8fae1 service nova] Acquired lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG nova.network.neutron [req-0448812f-aea4-49fe-a7a5-a9efb8ec2346 req-4d7dfedf-5d04-4eb1-8941-815f47d8fae1 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Refreshing network info cache for port b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG nova.network.neutron [req-0448812f-aea4-49fe-a7a5-a9efb8ec2346 req-4d7dfedf-5d04-4eb1-8941-815f47d8fae1 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Updated VIF entry in instance network info cache for port b04dafcc-e150-43c9-b4ad-82843e7d8802. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG nova.network.neutron [req-0448812f-aea4-49fe-a7a5-a9efb8ec2346 req-4d7dfedf-5d04-4eb1-8941-815f47d8fae1 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Updating instance_info_cache with network_info: [{"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:03:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0448812f-aea4-49fe-a7a5-a9efb8ec2346 req-4d7dfedf-5d04-4eb1-8941-815f47d8fae1 service nova] Releasing lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG os_brick.utils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667d710-7bcf-4afd-ad0b-17969b85d3d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc91b904-23da-412c-b2ab-54c663788f89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[87888596-9c50-4eaa-a182-ed70b4b16fe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4969380-18d9-4e1b-9013-8ad5ab1ed42d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:03:33 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1812e2be-1415-43eb-9a14-9e4f4f7f32fa]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG os_brick.utils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Updating existing volume attachment record: 382b2a68-b752-46d7-b47f-1eaa45beb034 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:03:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:03:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:03:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:03:37 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:03:37 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8590MB free_disk=25.132266998291016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 3afa9363-b190-49d2-a05b-95863a58ac9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:03:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:39 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:03:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:03:40 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Creating image(s)
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Ensure instance console log exists: /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Start _get_guest_xml network_info=[{"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '382b2a68-b752-46d7-b47f-1eaa45beb034', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlUXnOSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd841dfdd-f50e-4e00-829e-1c042a9de611', 'serial': 'd841dfdd-f50e-4e00-829e-1c042a9de611'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:03:40 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:03:40 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlUXnOSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:03:40 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:03:40 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:03:40 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[99033eec-7ad6-4d0b-8dea-cc4dbbff0f7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:03:40 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[16127581-d6a4-4c54-8484-e60aff55227d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611] added
Jul 27 10:03:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0033f41-9ff2-4e2a-a1ab-bea74d3790c9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da6083-71e6-4b13-9676-ec67614e0b78]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlUXnOSz {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlUXnOSz" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2eb0fc-9c83-404b-bbb9-e38a184e0345]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZlUXnOSz'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eb0b50-b1f3-47cc-9cd2-fd4afddec610]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84dab4-8771-4bb7-b7e3-fa99401b49df]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:03:40 user nova-compute[70374]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)
Jul 27 10:03:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:03:40 user nova-compute[70374]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)
Jul 27 10:03:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ce900-f191-464a-8275-5b8d54137243]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611, portal: 172.16.0.220,3260]
Jul 27 10:03:40 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611, portal: 172.16.0.220,3260] successful.
Jul 27 10:03:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[92521493-171d-4507-bc46-f2d1710cbd16]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5240bed-5a6b-432a-b313-59fe01a1dbe2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:03:40 user nova-compute[70374]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)
Jul 27 10:03:40 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:03:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:03:40 user nova-compute[70374]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)
Jul 27 10:03:40 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:03:40 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[945ef735-4abe-4068-b082-a1f4423bd4ef]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:03:40 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlUXnOSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "3afa9363-b190-49d2-a05b-95863a58ac9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:41 user nova-compute[70374]: INFO nova.compute.manager [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Terminating instance
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23061333531356434', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061333531356434', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-7cc27b2b-f48f-4b7d-9a34-c57689f8a6f3 req-515bfe70-236e-458a-9f4d-6cfd41dd9e22 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received event network-vif-unplugged-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7cc27b2b-f48f-4b7d-9a34-c57689f8a6f3 req-515bfe70-236e-458a-9f4d-6cfd41dd9e22 service nova] Acquiring lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7cc27b2b-f48f-4b7d-9a34-c57689f8a6f3 req-515bfe70-236e-458a-9f4d-6cfd41dd9e22 service nova] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7cc27b2b-f48f-4b7d-9a34-c57689f8a6f3 req-515bfe70-236e-458a-9f4d-6cfd41dd9e22 service nova] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-7cc27b2b-f48f-4b7d-9a34-c57689f8a6f3 req-515bfe70-236e-458a-9f4d-6cfd41dd9e22 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] No waiting events found dispatching network-vif-unplugged-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-7cc27b2b-f48f-4b7d-9a34-c57689f8a6f3 req-515bfe70-236e-458a-9f4d-6cfd41dd9e22 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received event network-vif-unplugged-76eadb21-7733-49c9-8614-76246a2277ed for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1759550182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1759550182',id=44,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-lh0d7veq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:03:28Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:68:18,bridge_name='br-int',has_traffic_filtering=True,id=b04dafcc-e150-43c9-b4ad-82843e7d8802,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04dafcc-e1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.objects.instance [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'pci_devices' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:03:41 user nova-compute[70374]:   <uuid>918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e</uuid>
Jul 27 10:03:41 user nova-compute[70374]:   <name>instance-0000002c</name>
Jul 27 10:03:41 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:03:41 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:03:41 user nova-compute[70374]:   <metadata>
Jul 27 10:03:41 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:03:41 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:03:41 user nova-compute[70374]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1759550182</nova:name>
Jul 27 10:03:41 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:03:40</nova:creationTime>
Jul 27 10:03:41 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:03:41 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:03:41 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:03:41 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:03:41 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:03:41 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:03:41 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:03:41 user nova-compute[70374]:       <nova:owner>
Jul 27 10:03:41 user nova-compute[70374]:         <nova:user uuid="653bb45e82be4371b55519bbf5308711">tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member</nova:user>
Jul 27 10:03:41 user nova-compute[70374]:         <nova:project uuid="15442b359a014219b7854237eaaad0d3">tempest-ServerBootFromVolumeStableRescueTest-1815884142</nova:project>
Jul 27 10:03:41 user nova-compute[70374]:       </nova:owner>
Jul 27 10:03:41 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 10:03:41 user nova-compute[70374]:       <nova:ports>
Jul 27 10:03:41 user nova-compute[70374]:         <nova:port uuid="b04dafcc-e150-43c9-b4ad-82843e7d8802">
Jul 27 10:03:41 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 10:03:41 user nova-compute[70374]:         </nova:port>
Jul 27 10:03:41 user nova-compute[70374]:       </nova:ports>
Jul 27 10:03:41 user nova-compute[70374]:     </nova:instance>
Jul 27 10:03:41 user nova-compute[70374]:   </metadata>
Jul 27 10:03:41 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:03:41 user nova-compute[70374]:     <system>
Jul 27 10:03:41 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:03:41 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:03:41 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:03:41 user nova-compute[70374]:       <entry name="serial">918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e</entry>
Jul 27 10:03:41 user nova-compute[70374]:       <entry name="uuid">918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e</entry>
Jul 27 10:03:41 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:03:41 user nova-compute[70374]:     </system>
Jul 27 10:03:41 user nova-compute[70374]:   </sysinfo>
Jul 27 10:03:41 user nova-compute[70374]:   <os>
Jul 27 10:03:41 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:03:41 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:03:41 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:03:41 user nova-compute[70374]:   </os>
Jul 27 10:03:41 user nova-compute[70374]:   <features>
Jul 27 10:03:41 user nova-compute[70374]:     <acpi/>
Jul 27 10:03:41 user nova-compute[70374]:     <apic/>
Jul 27 10:03:41 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:03:41 user nova-compute[70374]:   </features>
Jul 27 10:03:41 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:03:41 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:03:41 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:03:41 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:03:41 user nova-compute[70374]:   </clock>
Jul 27 10:03:41 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:03:41 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:03:41 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:03:41 user nova-compute[70374]:   </cpu>
Jul 27 10:03:41 user nova-compute[70374]:   <devices>
Jul 27 10:03:41 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:03:41 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:03:41 user nova-compute[70374]:       <source dev="/dev/sdd"/>
Jul 27 10:03:41 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:03:41 user nova-compute[70374]:       <serial>d841dfdd-f50e-4e00-829e-1c042a9de611</serial>
Jul 27 10:03:41 user nova-compute[70374]:     </disk>
Jul 27 10:03:41 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:03:41 user nova-compute[70374]:       <mac address="fa:16:3e:2a:68:18"/>
Jul 27 10:03:41 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:03:41 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:03:41 user nova-compute[70374]:       <target dev="tapb04dafcc-e1"/>
Jul 27 10:03:41 user nova-compute[70374]:     </interface>
Jul 27 10:03:41 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:03:41 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/console.log" append="off"/>
Jul 27 10:03:41 user nova-compute[70374]:     </serial>
Jul 27 10:03:41 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:03:41 user nova-compute[70374]:     <video>
Jul 27 10:03:41 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:03:41 user nova-compute[70374]:     </video>
Jul 27 10:03:41 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:03:41 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:03:41 user nova-compute[70374]:     </rng>
Jul 27 10:03:41 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:03:41 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:03:41 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:03:41 user nova-compute[70374]:     </memballoon>
Jul 27 10:03:41 user nova-compute[70374]:   </devices>
Jul 27 10:03:41 user nova-compute[70374]: </domain>
Jul 27 10:03:41 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1759550182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1759550182',id=44,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-lh0d7veq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:03:28Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:68:18,bridge_name='br-int',has_traffic_filtering=True,id=b04dafcc-e150-43c9-b4ad-82843e7d8802,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04dafcc-e1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG os_vif [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:68:18,bridge_name='br-int',has_traffic_filtering=True,id=b04dafcc-e150-43c9-b4ad-82843e7d8802,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04dafcc-e1') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb04dafcc-e1, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb04dafcc-e1, col_values=(('external_ids', {'iface-id': 'b04dafcc-e150-43c9-b4ad-82843e7d8802', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:68:18', 'vm-uuid': '918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:41 user nova-compute[70374]: INFO os_vif [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:68:18,bridge_name='br-int',has_traffic_filtering=True,id=b04dafcc-e150-43c9-b4ad-82843e7d8802,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04dafcc-e1')
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:03:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No VIF found with MAC fa:16:3e:2a:68:18, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:03:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Instance destroyed successfully.
Jul 27 10:03:42 user nova-compute[70374]: DEBUG nova.objects.instance [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'resources' on Instance uuid 3afa9363-b190-49d2-a05b-95863a58ac9f {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1101838999',display_name='tempest-TestVolumeBootPattern-server-1101838999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1101838999',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:02:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-c3qkclen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:02:08Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=3afa9363-b190-49d2-a05b-95863a58ac9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "76eadb21-7733-49c9-8614-76246a2277ed", "address": "fa:16:3e:3c:a0:f3", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76eadb21-77", "ovs_interfaceid": "76eadb21-7733-49c9-8614-76246a2277ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=76eadb21-7733-49c9-8614-76246a2277ed,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76eadb21-77') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_vif [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=76eadb21-7733-49c9-8614-76246a2277ed,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76eadb21-77') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76eadb21-77, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:42 user nova-compute[70374]: INFO os_vif [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=76eadb21-7733-49c9-8614-76246a2277ed,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76eadb21-77')
Jul 27 10:03:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKwBUniQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:03:42 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf2b723-8f52-4093-a136-849a5fd6e1ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:03:42 user nova-compute[70374]: No targets found.
Jul 27 10:03:42 user nova-compute[70374]: iSNS:
Jul 27 10:03:42 user nova-compute[70374]: No targets found.
Jul 27 10:03:42 user nova-compute[70374]: STATIC:
Jul 27 10:03:42 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611
Jul 27 10:03:42 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:03:42 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:03:42 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc
Jul 27 10:03:42 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:03:42 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:03:42 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 10:03:42 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:03:42 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:03:42 user nova-compute[70374]: FIRMWARE:
Jul 27 10:03:42 user nova-compute[70374]: No targets found.
Jul 27 10:03:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:03:42 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:03:42 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6161ed3e-56bd-4ce9-9923-d09862d0d56e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b1308a-d89e-49d6-bac7-81575191e0ad]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:03:42 user nova-compute[70374]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)
Jul 27 10:03:42 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:03:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:03:42 user nova-compute[70374]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc (non-flash)
Jul 27 10:03:42 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:03:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc7dd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dfeda7-ba7b-4387-a6e8-91c6ea36f464]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e04bde-566c-4183-9ff0-03e72f95fcc4]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0fec05-d986-4645-882f-6aeef5ee2ad8]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4212d2c-aac6-452f-a0da-dc1475a3ef82]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.102s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56856f7-47f9-44ce-8af3-ce45c9746f72]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0c4c0b-3d24-439c-ac35-7251383111e3]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc, portal: 172.16.0.220,3260]
Jul 27 10:03:42 user nova-compute[70374]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc, portal: 172.16.0.220,3260] successful.
Jul 27 10:03:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35297fe9-208e-41b9-bb66-a8e999c72edc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef30b6a-4eef-4e91-a40d-13845a922752]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== disconnect_volume: return (379ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:03:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Deleting instance files /opt/stack/data/nova/instances/3afa9363-b190-49d2-a05b-95863a58ac9f_del
Jul 27 10:03:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Deletion of /opt/stack/data/nova/instances/3afa9363-b190-49d2-a05b-95863a58ac9f_del complete
Jul 27 10:03:42 user nova-compute[70374]: INFO nova.compute.manager [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Took 1.52 seconds to destroy the instance on the hypervisor.
Jul 27 10:03:42 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:03:42 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-1d837167-6162-4d2c-9344-6f7b361763fd req-39b74ead-889a-485f-9ac6-11ab6bcef946 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received event network-vif-deleted-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:03:43 user nova-compute[70374]: INFO nova.compute.manager [req-1d837167-6162-4d2c-9344-6f7b361763fd req-39b74ead-889a-485f-9ac6-11ab6bcef946 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Neutron deleted interface 76eadb21-7733-49c9-8614-76246a2277ed; detaching it from the instance and deleting it from the info cache
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-1d837167-6162-4d2c-9344-6f7b361763fd req-39b74ead-889a-485f-9ac6-11ab6bcef946 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:03:43 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Took 0.54 seconds to deallocate network for instance.
Jul 27 10:03:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-1d837167-6162-4d2c-9344-6f7b361763fd req-39b74ead-889a-485f-9ac6-11ab6bcef946 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Detach interface failed, port_id=76eadb21-7733-49c9-8614-76246a2277ed, reason: Instance 3afa9363-b190-49d2-a05b-95863a58ac9f could not be found. {{(pid=70374) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received event network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Acquiring lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] No waiting events found dispatching network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:03:43 user nova-compute[70374]: WARNING nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Received unexpected event network-vif-plugged-76eadb21-7733-49c9-8614-76246a2277ed for instance with vm_state active and task_state deleting.
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:03:43 user nova-compute[70374]: WARNING nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state building and task_state spawning.
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:03:43 user nova-compute[70374]: WARNING nova.compute.manager [req-6a34d73a-0b76-4e32-9592-a4d51986d659 req-35a21f3f-5b2a-47cf-bf44-b397f833b4e9 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state building and task_state spawning.
Jul 27 10:03:43 user nova-compute[70374]: INFO nova.compute.manager [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Took 0.72 seconds to detach 1 volumes for instance.
Jul 27 10:03:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Deleting volume: 35297fe9-208e-41b9-bb66-a8e999c72edc {{(pid=70374) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:03:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:03:44 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:03:44 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:03:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:44 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Deleted allocations for instance 3afa9363-b190-49d2-a05b-95863a58ac9f
Jul 27 10:03:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-edc66d56-94be-493e-b6e2-09708670ab38 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "3afa9363-b190-49d2-a05b-95863a58ac9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.249s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452225.2557154, 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:03:45 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] VM Resumed (Lifecycle Event)
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:03:45 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance spawned successfully.
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:03:45 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452225.2558117, 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:03:45 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] VM Started (Lifecycle Event)
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:03:45 user nova-compute[70374]: INFO nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 27 10:03:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:03:45 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:03:45 user nova-compute[70374]: INFO nova.compute.manager [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Took 17.92 seconds to build instance.
Jul 27 10:03:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-58006993-be40-47c5-84cd-a4612bfb24ff tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.031s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:03:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:03:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:03:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:03:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:03:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:03:57 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452222.105751, 3afa9363-b190-49d2-a05b-95863a58ac9f => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:03:57 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] VM Stopped (Lifecycle Event)
Jul 27 10:03:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0d36cf4d-081e-4242-a436-6a194c27c8c1 None None] [instance: 3afa9363-b190-49d2-a05b-95863a58ac9f] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:03:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:04:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:04:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:04:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:04:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:04:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:04:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:34 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:04:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:04:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:04:34 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:04:34 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Updating instance_info_cache with network_info: [{"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:04:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:04:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:04:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:04:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:04:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:04:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:04:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:38 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:04:39 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:04:39 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=25.130508422851562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:04:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:04:40 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:04:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:04:48 user nova-compute[70374]: INFO nova.compute.claims [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Claim successful on node user
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:04:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:04:48 user nova-compute[70374]: INFO nova.virt.block_device [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Booting with volume 224d01fb-2958-40d7-9265-711218e28cdc at /dev/vda
Jul 27 10:04:48 user nova-compute[70374]: DEBUG nova.policy [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6e02625621443392a958dd87d679a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e1ff0e178842deba4c0efce3b84cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG os_brick.utils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba7fe46-d729-48cf-b4af-7d32d8232877]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[68704aa1-d780-44d1-87a6-716b837693f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d31367-5eb8-4342-8c16-d9191f480a6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea8a09-e3aa-4505-9a8f-0c8b863bfb29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:48 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:04:49 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:04:49 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e5ed58-92f1-44f3-baa4-52f8ae9aef2d]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG os_brick.utils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Updating existing volume attachment record: 879170ef-0e26-4eb3-a98b-35716e4b5445 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:04:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Successfully created port: b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:04:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Successfully updated port: b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:04:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:04:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquired lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:04:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:04:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-0a220d22-25fa-4325-bf36-da4deb136a1a req-cf793102-7629-445e-badf-fabed4bc7816 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received event network-changed-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:04:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-0a220d22-25fa-4325-bf36-da4deb136a1a req-cf793102-7629-445e-badf-fabed4bc7816 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Refreshing instance network info cache due to event network-changed-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:04:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0a220d22-25fa-4325-bf36-da4deb136a1a req-cf793102-7629-445e-badf-fabed4bc7816 service nova] Acquiring lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:04:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:04:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Updating instance_info_cache with network_info: [{"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:04:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Releasing lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:04:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Instance network_info: |[{"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:04:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0a220d22-25fa-4325-bf36-da4deb136a1a req-cf793102-7629-445e-badf-fabed4bc7816 service nova] Acquired lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:04:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-0a220d22-25fa-4325-bf36-da4deb136a1a req-cf793102-7629-445e-badf-fabed4bc7816 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Refreshing network info cache for port b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:04:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-0a220d22-25fa-4325-bf36-da4deb136a1a req-cf793102-7629-445e-badf-fabed4bc7816 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Updated VIF entry in instance network info cache for port b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:04:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-0a220d22-25fa-4325-bf36-da4deb136a1a req-cf793102-7629-445e-badf-fabed4bc7816 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Updating instance_info_cache with network_info: [{"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:04:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0a220d22-25fa-4325-bf36-da4deb136a1a req-cf793102-7629-445e-badf-fabed4bc7816 service nova] Releasing lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:04:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:04:55 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Creating image(s)
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Ensure instance console log exists: /opt/stack/data/nova/instances/82ab1f89-71d2-4839-a705-8506aa76eb5d/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Start _get_guest_xml network_info=[{"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '879170ef-0e26-4eb3-a98b-35716e4b5445', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFkKISVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82ab1f89-71d2-4839-a705-8506aa76eb5d', 'attached_at': '', 'detached_at': '', 'volume_id': '224d01fb-2958-40d7-9265-711218e28cdc', 'serial': '224d01fb-2958-40d7-9265-711218e28cdc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:04:55 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:04:55 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFkKISVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:04:55 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:04:55 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:04:55 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[143bf0ca-8f49-49f9-b047-37d064fbfad2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:04:55 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6b980d-efc4-4e15-9e2c-20dfd4d753e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc] added
Jul 27 10:04:55 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf7707f-ea60-4def-bc76-465185ed558d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e76d6b-feba-4100-969b-9b6f696f718e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFkKISVe {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFkKISVe" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c716fa3e-eff7-45fb-b9da-0beaebe6c3be]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OFkKISVe'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7019a54-98fc-4f54-a87b-44b3c62dba66]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f98cacc-0a5c-4b29-b65b-b56e10033f20]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:04:55 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:04:55 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:04:55 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:04:55 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a50b930-c3f0-4c1d-8f76-d989a1d1ab41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc, portal: 172.16.0.220,3260]
Jul 27 10:04:55 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc, portal: 172.16.0.220,3260] successful.
Jul 27 10:04:55 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b340fe-a2e0-4071-832e-d05904133d51]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee4ce9c-7d0f-40bb-82bc-5a40a95be3b5]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:04:55 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:04:55 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:04:55 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:04:55 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:04:55 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:04:55 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa8fe9-1ed5-4945-be63-82871a7347f2]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:04:55 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFkKISVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23665626463633139', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665626463633139', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-30299694',display_name='tempest-TestVolumeBootPattern-volume-backed-server-30299694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-30299694',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuQQ9rsLV9jDcGbtoO9mK6R0DQg35dOjVqsd1roR7izgFL1hk6PmTvEBah2v9rMFxltQIRSkVEh6R97FxStORSpzmnpRTNPYgsQ1eQahJ7OukcI1U44Dclq0jdTCMyN2A==',key_name='tempest-keypair-703067748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-wh4edhhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:04:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6e02625621443392a958dd87d679a3',uuid=82ab1f89-71d2-4839-a705-8506aa76eb5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c9:ec,bridge_name='br-int',has_traffic_filtering=True,id=b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a0f200-bc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'pci_devices' on Instance uuid 82ab1f89-71d2-4839-a705-8506aa76eb5d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:04:56 user nova-compute[70374]:   <uuid>82ab1f89-71d2-4839-a705-8506aa76eb5d</uuid>
Jul 27 10:04:56 user nova-compute[70374]:   <name>instance-0000002d</name>
Jul 27 10:04:56 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:04:56 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:04:56 user nova-compute[70374]:   <metadata>
Jul 27 10:04:56 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:04:56 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:04:56 user nova-compute[70374]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-30299694</nova:name>
Jul 27 10:04:56 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:04:55</nova:creationTime>
Jul 27 10:04:56 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:04:56 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:04:56 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:04:56 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:04:56 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:04:56 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:04:56 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:04:56 user nova-compute[70374]:       <nova:owner>
Jul 27 10:04:56 user nova-compute[70374]:         <nova:user uuid="fc6e02625621443392a958dd87d679a3">tempest-TestVolumeBootPattern-953954878-project-member</nova:user>
Jul 27 10:04:56 user nova-compute[70374]:         <nova:project uuid="52e1ff0e178842deba4c0efce3b84cf8">tempest-TestVolumeBootPattern-953954878</nova:project>
Jul 27 10:04:56 user nova-compute[70374]:       </nova:owner>
Jul 27 10:04:56 user nova-compute[70374]:       <nova:ports>
Jul 27 10:04:56 user nova-compute[70374]:         <nova:port uuid="b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e">
Jul 27 10:04:56 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 10:04:56 user nova-compute[70374]:         </nova:port>
Jul 27 10:04:56 user nova-compute[70374]:       </nova:ports>
Jul 27 10:04:56 user nova-compute[70374]:     </nova:instance>
Jul 27 10:04:56 user nova-compute[70374]:   </metadata>
Jul 27 10:04:56 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:04:56 user nova-compute[70374]:     <system>
Jul 27 10:04:56 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:04:56 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:04:56 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:04:56 user nova-compute[70374]:       <entry name="serial">82ab1f89-71d2-4839-a705-8506aa76eb5d</entry>
Jul 27 10:04:56 user nova-compute[70374]:       <entry name="uuid">82ab1f89-71d2-4839-a705-8506aa76eb5d</entry>
Jul 27 10:04:56 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:04:56 user nova-compute[70374]:     </system>
Jul 27 10:04:56 user nova-compute[70374]:   </sysinfo>
Jul 27 10:04:56 user nova-compute[70374]:   <os>
Jul 27 10:04:56 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:04:56 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:04:56 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:04:56 user nova-compute[70374]:   </os>
Jul 27 10:04:56 user nova-compute[70374]:   <features>
Jul 27 10:04:56 user nova-compute[70374]:     <acpi/>
Jul 27 10:04:56 user nova-compute[70374]:     <apic/>
Jul 27 10:04:56 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:04:56 user nova-compute[70374]:   </features>
Jul 27 10:04:56 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:04:56 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:04:56 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:04:56 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:04:56 user nova-compute[70374]:   </clock>
Jul 27 10:04:56 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:04:56 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:04:56 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:04:56 user nova-compute[70374]:   </cpu>
Jul 27 10:04:56 user nova-compute[70374]:   <devices>
Jul 27 10:04:56 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:04:56 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:04:56 user nova-compute[70374]:       <source dev="/dev/sdc"/>
Jul 27 10:04:56 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:04:56 user nova-compute[70374]:       <serial>224d01fb-2958-40d7-9265-711218e28cdc</serial>
Jul 27 10:04:56 user nova-compute[70374]:     </disk>
Jul 27 10:04:56 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:04:56 user nova-compute[70374]:       <mac address="fa:16:3e:f9:c9:ec"/>
Jul 27 10:04:56 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:04:56 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:04:56 user nova-compute[70374]:       <target dev="tapb4a0f200-bc"/>
Jul 27 10:04:56 user nova-compute[70374]:     </interface>
Jul 27 10:04:56 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:04:56 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/82ab1f89-71d2-4839-a705-8506aa76eb5d/console.log" append="off"/>
Jul 27 10:04:56 user nova-compute[70374]:     </serial>
Jul 27 10:04:56 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:04:56 user nova-compute[70374]:     <video>
Jul 27 10:04:56 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:04:56 user nova-compute[70374]:     </video>
Jul 27 10:04:56 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:04:56 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:04:56 user nova-compute[70374]:     </rng>
Jul 27 10:04:56 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:04:56 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:04:56 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:04:56 user nova-compute[70374]:     </memballoon>
Jul 27 10:04:56 user nova-compute[70374]:   </devices>
Jul 27 10:04:56 user nova-compute[70374]: </domain>
Jul 27 10:04:56 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-30299694',display_name='tempest-TestVolumeBootPattern-volume-backed-server-30299694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-30299694',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuQQ9rsLV9jDcGbtoO9mK6R0DQg35dOjVqsd1roR7izgFL1hk6PmTvEBah2v9rMFxltQIRSkVEh6R97FxStORSpzmnpRTNPYgsQ1eQahJ7OukcI1U44Dclq0jdTCMyN2A==',key_name='tempest-keypair-703067748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-wh4edhhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:04:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6e02625621443392a958dd87d679a3',uuid=82ab1f89-71d2-4839-a705-8506aa76eb5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c9:ec,bridge_name='br-int',has_traffic_filtering=True,id=b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a0f200-bc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG os_vif [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c9:ec,bridge_name='br-int',has_traffic_filtering=True,id=b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a0f200-bc') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4a0f200-bc, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4a0f200-bc, col_values=(('external_ids', {'iface-id': 'b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:c9:ec', 'vm-uuid': '82ab1f89-71d2-4839-a705-8506aa76eb5d'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:56 user nova-compute[70374]: INFO os_vif [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c9:ec,bridge_name='br-int',has_traffic_filtering=True,id=b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a0f200-bc')
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:04:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No VIF found with MAC fa:16:3e:f9:c9:ec, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-b3d270a7-0374-4baf-8a24-37ae7b06c915 req-2c1160dc-4b85-48a2-af84-cdaa8dc82aac service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received event network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b3d270a7-0374-4baf-8a24-37ae7b06c915 req-2c1160dc-4b85-48a2-af84-cdaa8dc82aac service nova] Acquiring lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b3d270a7-0374-4baf-8a24-37ae7b06c915 req-2c1160dc-4b85-48a2-af84-cdaa8dc82aac service nova] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b3d270a7-0374-4baf-8a24-37ae7b06c915 req-2c1160dc-4b85-48a2-af84-cdaa8dc82aac service nova] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG nova.compute.manager [req-b3d270a7-0374-4baf-8a24-37ae7b06c915 req-2c1160dc-4b85-48a2-af84-cdaa8dc82aac service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] No waiting events found dispatching network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:04:58 user nova-compute[70374]: WARNING nova.compute.manager [req-b3d270a7-0374-4baf-8a24-37ae7b06c915 req-2c1160dc-4b85-48a2-af84-cdaa8dc82aac service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received unexpected event network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e for instance with vm_state building and task_state spawning.
Jul 27 10:04:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:04:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452300.3478057, 82ab1f89-71d2-4839-a705-8506aa76eb5d => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:05:00 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] VM Resumed (Lifecycle Event)
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:05:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Instance spawned successfully.
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:05:00 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452300.3513389, 82ab1f89-71d2-4839-a705-8506aa76eb5d => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:05:00 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] VM Started (Lifecycle Event)
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:05:00 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:05:00 user nova-compute[70374]: INFO nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Took 5.03 seconds to spawn the instance on the hypervisor.
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.compute.manager [req-811e1a30-7a6f-470b-aadd-237c345a0822 req-fe0d35bd-c4e2-493c-bb02-8d573f1394de service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received event network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-811e1a30-7a6f-470b-aadd-237c345a0822 req-fe0d35bd-c4e2-493c-bb02-8d573f1394de service nova] Acquiring lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-811e1a30-7a6f-470b-aadd-237c345a0822 req-fe0d35bd-c4e2-493c-bb02-8d573f1394de service nova] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-811e1a30-7a6f-470b-aadd-237c345a0822 req-fe0d35bd-c4e2-493c-bb02-8d573f1394de service nova] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG nova.compute.manager [req-811e1a30-7a6f-470b-aadd-237c345a0822 req-fe0d35bd-c4e2-493c-bb02-8d573f1394de service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] No waiting events found dispatching network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:05:00 user nova-compute[70374]: WARNING nova.compute.manager [req-811e1a30-7a6f-470b-aadd-237c345a0822 req-fe0d35bd-c4e2-493c-bb02-8d573f1394de service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received unexpected event network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e for instance with vm_state building and task_state spawning.
Jul 27 10:05:00 user nova-compute[70374]: INFO nova.compute.manager [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Took 12.28 seconds to build instance.
Jul 27 10:05:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0b65b476-4f48-463e-b2b5-5bff4e94f27f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.381s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:18 user nova-compute[70374]: INFO nova.compute.manager [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Rescuing
Jul 27 10:05:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquired lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG nova.network.neutron [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Updating instance_info_cache with network_info: [{"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Releasing lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-a025d09b-9dac-482b-9c94-53cf2e31ceb5 req-35e2aae4-f486-4eb3-b71e-43e2837c33e8 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a025d09b-9dac-482b-9c94-53cf2e31ceb5 req-35e2aae4-f486-4eb3-b71e-43e2837c33e8 service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a025d09b-9dac-482b-9c94-53cf2e31ceb5 req-35e2aae4-f486-4eb3-b71e-43e2837c33e8 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a025d09b-9dac-482b-9c94-53cf2e31ceb5 req-35e2aae4-f486-4eb3-b71e-43e2837c33e8 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-a025d09b-9dac-482b-9c94-53cf2e31ceb5 req-35e2aae4-f486-4eb3-b71e-43e2837c33e8 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:05:18 user nova-compute[70374]: WARNING nova.compute.manager [req-a025d09b-9dac-482b-9c94-53cf2e31ceb5 req-35e2aae4-f486-4eb3-b71e-43e2837c33e8 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state active and task_state rescuing.
Jul 27 10:05:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance destroyed successfully.
Jul 27 10:05:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Attempting a stable device rescue
Jul 27 10:05:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70374) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 10:05:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance directory exists: not creating {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 10:05:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Creating image(s)
Jul 27 10:05:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "/opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "/opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "/opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:19 user nova-compute[70374]: DEBUG nova.objects.instance [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'trusted_certs' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:05:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "bb1f681378f4d40a02cd5e54fc39771cad914939" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "bb1f681378f4d40a02cd5e54fc39771cad914939" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939.part --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939.part --force-share --output=json" returned: 0 in 0.152s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG nova.virt.images [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] 914dfef1-5447-4f3f-ba4d-7d1249b724ad was qcow2, converting to raw {{(pid=70374) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG nova.privsep.utils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70374) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939.part /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939.converted {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939.part /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939.converted" returned: 0 in 0.209s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939.converted --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "bb1f681378f4d40a02cd5e54fc39771cad914939" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.515s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "bb1f681378f4d40a02cd5e54fc39771cad914939" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "bb1f681378f4d40a02cd5e54fc39771cad914939" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-f60fa748-755e-42fa-9f8d-e1b3716c7cd0 req-3d9a6e0d-6048-4e26-b0fd-af468681c86a service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f60fa748-755e-42fa-9f8d-e1b3716c7cd0 req-3d9a6e0d-6048-4e26-b0fd-af468681c86a service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f60fa748-755e-42fa-9f8d-e1b3716c7cd0 req-3d9a6e0d-6048-4e26-b0fd-af468681c86a service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f60fa748-755e-42fa-9f8d-e1b3716c7cd0 req-3d9a6e0d-6048-4e26-b0fd-af468681c86a service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.compute.manager [req-f60fa748-755e-42fa-9f8d-e1b3716c7cd0 req-3d9a6e0d-6048-4e26-b0fd-af468681c86a service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:05:21 user nova-compute[70374]: WARNING nova.compute.manager [req-f60fa748-755e-42fa-9f8d-e1b3716c7cd0 req-3d9a6e0d-6048-4e26-b0fd-af468681c86a service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state active and task_state rescuing.
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939 --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939,backing_fmt=raw /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939,backing_fmt=raw /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue" returned: 0 in 0.051s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "bb1f681378f4d40a02cd5e54fc39771cad914939" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'migration_context' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Start _get_guest_xml network_info=[{"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "vif_mac": "fa:16:3e:2a:68:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '914dfef1-5447-4f3f-ba4d-7d1249b724ad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '382b2a68-b752-46d7-b47f-1eaa45beb034', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlUXnOSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd841dfdd-f50e-4e00-829e-1c042a9de611', 'serial': 'd841dfdd-f50e-4e00-829e-1c042a9de611'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'resources' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'numa_topology' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:05:21 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:05:21 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'vcpu_model' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlUXnOSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:05:21 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:05:21 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:05:21 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab2354-c906-41e8-8cdf-bbf407988793]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZlUXnOSz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 10:05:21 user nova-compute[70374]: node.name = iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611
Jul 27 10:05:21 user nova-compute[70374]: node.tpgt = -1
Jul 27 10:05:21 user nova-compute[70374]: node.startup = automatic
Jul 27 10:05:21 user nova-compute[70374]: node.leading_login = No
Jul 27 10:05:21 user nova-compute[70374]: iface.iscsi_ifacename = default
Jul 27 10:05:21 user nova-compute[70374]: iface.net_ifacename = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.ipaddress = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.prefix_len = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.hwaddress = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.transport_name = tcp
Jul 27 10:05:21 user nova-compute[70374]: iface.initiatorname = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.state = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.vlan_id = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.vlan_priority = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.vlan_state = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.iface_num = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.mtu = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.port = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.bootproto = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.subnet_mask = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.gateway = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.dhcp_alt_client_id = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.dhcp_dns = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.dhcp_learn_iqn = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.dhcp_vendor_id_state = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.dhcp_vendor_id = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.dhcp_slp_da = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.fragmentation = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.gratuitous_arp = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.incoming_forwarding = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.tos_state = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.tos = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.ttl = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.delayed_ack = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.tcp_nagle = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.tcp_wsf_state = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.tcp_wsf = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.tcp_timer_scale = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.tcp_timestamp = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.redirect = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.def_task_mgmt_timeout = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.header_digest = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.data_digest = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.immediate_data = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.initial_r2t = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.data_seq_inorder = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.data_pdu_inorder = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.erl = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.max_receive_data_len = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.first_burst_len = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.max_outstanding_r2t = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.max_burst_len = 0
Jul 27 10:05:21 user nova-compute[70374]: iface.chap_auth = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.bidi_chap = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.strict_login_compliance = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.discovery_auth = <empty>
Jul 27 10:05:21 user nova-compute[70374]: iface.discovery_logout = <empty>
Jul 27 10:05:21 user nova-compute[70374]: node.discovery_address = <empty>
Jul 27 10:05:21 user nova-compute[70374]: node.discovery_port = 0
Jul 27 10:05:21 user nova-compute[70374]: node.discovery_type = static
Jul 27 10:05:21 user nova-compute[70374]: node.session.initial_cmdsn = 0
Jul 27 10:05:21 user nova-compute[70374]: node.session.initial_login_retry_max = 8
Jul 27 10:05:21 user nova-compute[70374]: node.session.xmit_thread_priority = -20
Jul 27 10:05:21 user nova-compute[70374]: node.session.cmds_max = 128
Jul 27 10:05:21 user nova-compute[70374]: node.session.queue_depth = 32
Jul 27 10:05:21 user nova-compute[70374]: node.session.nr_sessions = 1
Jul 27 10:05:21 user nova-compute[70374]: node.session.auth.authmethod = CHAP
Jul 27 10:05:21 user nova-compute[70374]: node.session.auth.username = ZlUXnOSz
Jul 27 10:05:21 user nova-compute[70374]: node.session.auth.password = ***
Jul 27 10:05:21 user nova-compute[70374]: node.session.auth.username_in = <empty>
Jul 27 10:05:21 user nova-compute[70374]: node.session.auth.password_in = <empty>
Jul 27 10:05:21 user nova-compute[70374]: node.session.auth.chap_algs = MD5
Jul 27 10:05:21 user nova-compute[70374]: node.session.timeo.replacement_timeout = 120
Jul 27 10:05:21 user nova-compute[70374]: node.session.err_timeo.abort_timeout = 15
Jul 27 10:05:21 user nova-compute[70374]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 10:05:21 user nova-compute[70374]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 10:05:21 user nova-compute[70374]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.FastAbort = Yes
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.InitialR2T = No
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.ImmediateData = Yes
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.MaxConnections = 1
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 10:05:21 user nova-compute[70374]: node.session.iscsi.ERL = 0
Jul 27 10:05:21 user nova-compute[70374]: node.session.scan = manual
Jul 27 10:05:21 user nova-compute[70374]: node.session.reopen_max = 0
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].address = 172.16.0.220
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].port = 3260
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].startup = manual
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].tcp.window_size = 524288
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].tcp.type_of_service = 0
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].timeo.logout_timeout = 15
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].timeo.login_timeout = 15
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].timeo.auth_timeout = 45
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].iscsi.DataDigest = None
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].iscsi.IFMarker = No
Jul 27 10:05:21 user nova-compute[70374]: node.conn[0].iscsi.OFMarker = No
Jul 27 10:05:21 user nova-compute[70374]: # END RECORD
Jul 27 10:05:21 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.113s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d11a18-413b-4aba-a5a6-b2e140c7baed]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[449498e1-ac21-4e74-8179-e1730c3a68be]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlUXnOSz {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlUXnOSz" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac8bd8c-e905-43e6-abf2-f58e3927923d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZlUXnOSz'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbb113d-e279-4f23-a954-59ccdac48038]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b07bdfd-8618-4aa9-9028-471fbcd4c598]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:05:21 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:05:21 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:05:21 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:05:21 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:05:21 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:05:21 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] HCTL ('35', '0', '0', 0) found on session 49 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d04fc91-b2f1-4bc8-8e98-37f1ed323fc0]: (4, ('0 0 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Searching for a device in session 49 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlUXnOSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.260s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] <== connect_volume: return (261ms) {'type': 'block', 'scsi_wwn': '23061333531356434', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061333531356434', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1759550182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1759550182',id=44,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:03:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-lh0d7veq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:03:45Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "vif_mac": "fa:16:3e:2a:68:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "vif_mac": "fa:16:3e:2a:68:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:68:18,bridge_name='br-int',has_traffic_filtering=True,id=b04dafcc-e150-43c9-b4ad-82843e7d8802,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04dafcc-e1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.objects.instance [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'pci_devices' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:05:21 user nova-compute[70374]:   <uuid>918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e</uuid>
Jul 27 10:05:21 user nova-compute[70374]:   <name>instance-0000002c</name>
Jul 27 10:05:21 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:05:21 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:05:21 user nova-compute[70374]:   <metadata>
Jul 27 10:05:21 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:05:21 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:05:21 user nova-compute[70374]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1759550182</nova:name>
Jul 27 10:05:21 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:05:21</nova:creationTime>
Jul 27 10:05:21 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:05:21 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:05:21 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:05:21 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:05:21 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:05:21 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:05:21 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:05:21 user nova-compute[70374]:       <nova:owner>
Jul 27 10:05:21 user nova-compute[70374]:         <nova:user uuid="653bb45e82be4371b55519bbf5308711">tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member</nova:user>
Jul 27 10:05:21 user nova-compute[70374]:         <nova:project uuid="15442b359a014219b7854237eaaad0d3">tempest-ServerBootFromVolumeStableRescueTest-1815884142</nova:project>
Jul 27 10:05:21 user nova-compute[70374]:       </nova:owner>
Jul 27 10:05:21 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 10:05:21 user nova-compute[70374]:       <nova:ports>
Jul 27 10:05:21 user nova-compute[70374]:         <nova:port uuid="b04dafcc-e150-43c9-b4ad-82843e7d8802">
Jul 27 10:05:21 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 10:05:21 user nova-compute[70374]:         </nova:port>
Jul 27 10:05:21 user nova-compute[70374]:       </nova:ports>
Jul 27 10:05:21 user nova-compute[70374]:     </nova:instance>
Jul 27 10:05:21 user nova-compute[70374]:   </metadata>
Jul 27 10:05:21 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:05:21 user nova-compute[70374]:     <system>
Jul 27 10:05:21 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:05:21 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:05:21 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:05:21 user nova-compute[70374]:       <entry name="serial">918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e</entry>
Jul 27 10:05:21 user nova-compute[70374]:       <entry name="uuid">918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e</entry>
Jul 27 10:05:21 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:05:21 user nova-compute[70374]:     </system>
Jul 27 10:05:21 user nova-compute[70374]:   </sysinfo>
Jul 27 10:05:21 user nova-compute[70374]:   <os>
Jul 27 10:05:21 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:05:21 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:05:21 user nova-compute[70374]:   </os>
Jul 27 10:05:21 user nova-compute[70374]:   <features>
Jul 27 10:05:21 user nova-compute[70374]:     <acpi/>
Jul 27 10:05:21 user nova-compute[70374]:     <apic/>
Jul 27 10:05:21 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:05:21 user nova-compute[70374]:   </features>
Jul 27 10:05:21 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:05:21 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:05:21 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:05:21 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:05:21 user nova-compute[70374]:   </clock>
Jul 27 10:05:21 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:05:21 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:05:21 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:05:21 user nova-compute[70374]:   </cpu>
Jul 27 10:05:21 user nova-compute[70374]:   <devices>
Jul 27 10:05:21 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:05:21 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:05:21 user nova-compute[70374]:       <source dev="/dev/sdd"/>
Jul 27 10:05:21 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:05:21 user nova-compute[70374]:       <serial>d841dfdd-f50e-4e00-829e-1c042a9de611</serial>
Jul 27 10:05:21 user nova-compute[70374]:     </disk>
Jul 27 10:05:21 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 10:05:21 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 10:05:21 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue"/>
Jul 27 10:05:21 user nova-compute[70374]:       <target dev="vdb" bus="virtio"/>
Jul 27 10:05:21 user nova-compute[70374]:       <boot order="1"/>
Jul 27 10:05:21 user nova-compute[70374]:     </disk>
Jul 27 10:05:21 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:05:21 user nova-compute[70374]:       <mac address="fa:16:3e:2a:68:18"/>
Jul 27 10:05:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:05:21 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:05:21 user nova-compute[70374]:       <target dev="tapb04dafcc-e1"/>
Jul 27 10:05:21 user nova-compute[70374]:     </interface>
Jul 27 10:05:21 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:05:21 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/console.log" append="off"/>
Jul 27 10:05:21 user nova-compute[70374]:     </serial>
Jul 27 10:05:21 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:05:21 user nova-compute[70374]:     <video>
Jul 27 10:05:21 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:05:21 user nova-compute[70374]:     </video>
Jul 27 10:05:21 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:05:21 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:05:21 user nova-compute[70374]:     </rng>
Jul 27 10:05:21 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:05:21 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:05:21 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:05:21 user nova-compute[70374]:     </memballoon>
Jul 27 10:05:21 user nova-compute[70374]:   </devices>
Jul 27 10:05:21 user nova-compute[70374]: </domain>
Jul 27 10:05:21 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:05:21 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance destroyed successfully.
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] No VIF found with MAC fa:16:3e:2a:68:18, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:05:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-30c9a44b-d39f-4423-98de-022a7ae9d875 req-e6190c41-990d-462c-aed5-ee539452947d service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:05:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-30c9a44b-d39f-4423-98de-022a7ae9d875 req-e6190c41-990d-462c-aed5-ee539452947d service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-30c9a44b-d39f-4423-98de-022a7ae9d875 req-e6190c41-990d-462c-aed5-ee539452947d service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-30c9a44b-d39f-4423-98de-022a7ae9d875 req-e6190c41-990d-462c-aed5-ee539452947d service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:23 user nova-compute[70374]: DEBUG nova.compute.manager [req-30c9a44b-d39f-4423-98de-022a7ae9d875 req-e6190c41-990d-462c-aed5-ee539452947d service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:05:23 user nova-compute[70374]: WARNING nova.compute.manager [req-30c9a44b-d39f-4423-98de-022a7ae9d875 req-e6190c41-990d-462c-aed5-ee539452947d service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state active and task_state rescuing.
Jul 27 10:05:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:24 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 10:05:24 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452324.9635527, 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:05:24 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] VM Resumed (Lifecycle Event)
Jul 27 10:05:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-504c2a05-d96d-433c-b9b5-0c221bcb3d7c tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:05:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:05:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:05:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 10:05:25 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452324.9651167, 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:05:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] VM Started (Lifecycle Event)
Jul 27 10:05:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:05:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:05:25 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 10:05:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-c90319c0-c388-4e18-987a-03acc813a04c req-64cbecd0-22ac-4bb2-af32-b6876c460a45 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:05:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c90319c0-c388-4e18-987a-03acc813a04c req-64cbecd0-22ac-4bb2-af32-b6876c460a45 service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c90319c0-c388-4e18-987a-03acc813a04c req-64cbecd0-22ac-4bb2-af32-b6876c460a45 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c90319c0-c388-4e18-987a-03acc813a04c req-64cbecd0-22ac-4bb2-af32-b6876c460a45 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-c90319c0-c388-4e18-987a-03acc813a04c req-64cbecd0-22ac-4bb2-af32-b6876c460a45 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:05:25 user nova-compute[70374]: WARNING nova.compute.manager [req-c90319c0-c388-4e18-987a-03acc813a04c req-64cbecd0-22ac-4bb2-af32-b6876c460a45 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state rescued and task_state None.
Jul 27 10:05:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:30 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:05:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:05:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:40 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:05:41 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:05:41 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8435MB free_disk=25.032581329345703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 82ab1f89-71d2-4839-a705-8506aa76eb5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:05:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:42 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:05:42 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:05:42 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:05:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Verify base images {{(pid=70374) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70374) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Image id 35458adf-261a-4e0b-a4db-b243619b2394 yields fingerprint eecbf4ea539212b0e09996b77db3066885fb0ed1 {{(pid=70374) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] image 35458adf-261a-4e0b-a4db-b243619b2394 at (/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1): checking
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] image 35458adf-261a-4e0b-a4db-b243619b2394 at (/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1): image is in use {{(pid=70374) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e is a valid instance name {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] 06b6cb39-6667-4b3e-ba46-ecee8137ab90 is a valid instance name {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] 06b6cb39-6667-4b3e-ba46-ecee8137ab90 has a disk file {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 is backed by eecbf4ea539212b0e09996b77db3066885fb0ed1 {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] ffe6d95c-b6cd-4d0b-a276-553b0800c630 is a valid instance name {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] ffe6d95c-b6cd-4d0b-a276-553b0800c630 has a disk file {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 is backed by eecbf4ea539212b0e09996b77db3066885fb0ed1 {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] 82ab1f89-71d2-4839-a705-8506aa76eb5d is a valid instance name {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] 15c7721e-cebc-4f3a-a214-ea93ef21a80d is a valid instance name {{(pid=70374) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24
Jul 27 10:05:59 user nova-compute[70374]: WARNING nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Unknown base file: /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Active base files: /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Removable base files: /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056 /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00 /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851 /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1 /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24 /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/203720f9500ec23ca189a16e274863a29cc112ca
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bae11d73797624eb189e8f6bc965bcd6277bd72e
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f45ce42723178ed0c3f545cbb0d68bcf7bb43056
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9ac7a738160b6ad9c217996c889f1574494fab00
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/197dcf922b72716a75babfc37a05fb97e31be851
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/71e5091c60895e6350079700df90a189d8f4b8e1
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/774573cc70d44bf40d3c036098d0fb123c0e454c
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2a3d194f1ba413b9d40f99c3fc2dd57bd1d5cc24
Jul 27 10:05:59 user nova-compute[70374]: INFO nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bb1f681378f4d40a02cd5e54fc39771cad914939
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Verification complete {{(pid=70374) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Verify swap images {{(pid=70374) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 27 10:05:59 user nova-compute[70374]: DEBUG nova.virt.libvirt.imagecache [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Verify ephemeral images {{(pid=70374) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 27 10:06:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:06:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:06:31 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:06:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:06:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:06:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:06:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:06:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:37 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:37 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:06:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:06:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:06:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:06:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:06:38 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:06:39 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:06:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:06:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-6bb57008-129a-4cdb-8fb4-c2e146693db3 req-d0e3818e-c544-418d-9cf9-70d14dfbc233 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received event network-changed-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-6bb57008-129a-4cdb-8fb4-c2e146693db3 req-d0e3818e-c544-418d-9cf9-70d14dfbc233 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Refreshing instance network info cache due to event network-changed-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6bb57008-129a-4cdb-8fb4-c2e146693db3 req-d0e3818e-c544-418d-9cf9-70d14dfbc233 service nova] Acquiring lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6bb57008-129a-4cdb-8fb4-c2e146693db3 req-d0e3818e-c544-418d-9cf9-70d14dfbc233 service nova] Acquired lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-6bb57008-129a-4cdb-8fb4-c2e146693db3 req-d0e3818e-c544-418d-9cf9-70d14dfbc233 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Refreshing network info cache for port b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-6bb57008-129a-4cdb-8fb4-c2e146693db3 req-d0e3818e-c544-418d-9cf9-70d14dfbc233 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Updated VIF entry in instance network info cache for port b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-6bb57008-129a-4cdb-8fb4-c2e146693db3 req-d0e3818e-c544-418d-9cf9-70d14dfbc233 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Updating instance_info_cache with network_info: [{"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:06:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-6bb57008-129a-4cdb-8fb4-c2e146693db3 req-d0e3818e-c544-418d-9cf9-70d14dfbc233 service nova] Releasing lock "refresh_cache-82ab1f89-71d2-4839-a705-8506aa76eb5d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:06:42 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:06:42 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:06:42 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8475MB free_disk=25.03119659423828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:06:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 82ab1f89-71d2-4839-a705-8506aa76eb5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:06:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:06:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:06:48 user nova-compute[70374]: INFO nova.compute.claims [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Claim successful on node user
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:06:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.network.neutron [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:06:48 user nova-compute[70374]: INFO nova.virt.block_device [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Booting with volume snapshot 53299e8e-9338-4374-981d-61e1af1d76f7 at /dev/vda
Jul 27 10:06:48 user nova-compute[70374]: DEBUG nova.policy [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6e02625621443392a958dd87d679a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e1ff0e178842deba4c0efce3b84cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:06:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Successfully created port: 2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Successfully updated port: 2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquired lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-72047f8d-29c5-4e8d-9fb0-045e8bf433ab req-3f040555-1593-4dd4-9f84-a2cc8bc0a007 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received event network-changed-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG nova.compute.manager [req-72047f8d-29c5-4e8d-9fb0-045e8bf433ab req-3f040555-1593-4dd4-9f84-a2cc8bc0a007 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Refreshing instance network info cache due to event network-changed-2cd7530b-093b-44e6-bee9-e18c17424076. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-72047f8d-29c5-4e8d-9fb0-045e8bf433ab req-3f040555-1593-4dd4-9f84-a2cc8bc0a007 service nova] Acquiring lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Updating instance_info_cache with network_info: [{"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Releasing lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Instance network_info: |[{"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-72047f8d-29c5-4e8d-9fb0-045e8bf433ab req-3f040555-1593-4dd4-9f84-a2cc8bc0a007 service nova] Acquired lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:06:50 user nova-compute[70374]: DEBUG nova.network.neutron [req-72047f8d-29c5-4e8d-9fb0-045e8bf433ab req-3f040555-1593-4dd4-9f84-a2cc8bc0a007 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Refreshing network info cache for port 2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-72047f8d-29c5-4e8d-9fb0-045e8bf433ab req-3f040555-1593-4dd4-9f84-a2cc8bc0a007 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Updated VIF entry in instance network info cache for port 2cd7530b-093b-44e6-bee9-e18c17424076. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG nova.network.neutron [req-72047f8d-29c5-4e8d-9fb0-045e8bf433ab req-3f040555-1593-4dd4-9f84-a2cc8bc0a007 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Updating instance_info_cache with network_info: [{"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-72047f8d-29c5-4e8d-9fb0-045e8bf433ab req-3f040555-1593-4dd4-9f84-a2cc8bc0a007 service nova] Releasing lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:06:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG os_brick.utils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c677a41f-4606-4de7-8ed7-6d0cef962e98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afacb2e-f4ae-4c7b-b44c-a1b0ad2ef1e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba81dbac-e525-4277-842d-dc3192f03e0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cd7a15-fc3c-47ca-bd71-4690db739aca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:06:54 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:06:54 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e1b2ad-7f61-4a6c-85c5-27743705e5cc]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG os_brick.utils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:06:54 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Updating existing volume attachment record: 5e4bf055-e282-4550-8578-1088ea526a82 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:06:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:06:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:07:01 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Creating image(s)
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Ensure instance console log exists: /opt/stack/data/nova/instances/1a6d2a03-5122-4649-82bc-1fb334bb6e1d/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Start _get_guest_xml network_info=[{"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-27T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=fc887a36-66e6-40f8-968c-60a2a7127fa0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-843429360',owner='52e1ff0e178842deba4c0efce3b84cf8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-27T10:06:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '5e4bf055-e282-4550-8578-1088ea526a82', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thCMFjRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a6d2a03-5122-4649-82bc-1fb334bb6e1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2f196ab-5041-4c1b-89d7-28310f726f99', 'serial': 'c2f196ab-5041-4c1b-89d7-28310f726f99'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:07:01 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:07:01 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-27T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=fc887a36-66e6-40f8-968c-60a2a7127fa0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-843429360',owner='52e1ff0e178842deba4c0efce3b84cf8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-27T10:06:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thCMFjRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:07:01 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:07:01 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:07:01 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ea156-3b84-4eb5-8b95-72608f678081]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:07:01 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[827991d0-9969-4265-b49f-fbdcc4c00c1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99] added
Jul 27 10:07:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c64440c-a69e-4763-864a-b99e3fda1407]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb11887-4b17-418c-82a6-0de8d0e2dec3]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v thCMFjRy {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v thCMFjRy" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[061461f1-ab2f-475b-ae34-e2703d12250c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'thCMFjRy'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c5746e-609a-4e17-8c88-6cfeaedf237d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[066eaacf-a8a7-41c3-a29b-2b0af295252d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:07:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:07:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[044eadbc-b9a1-47d3-856a-f3179b22a3bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99, portal: 172.16.0.220,3260]
Jul 27 10:07:01 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99, portal: 172.16.0.220,3260] successful.
Jul 27 10:07:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[676293fa-6302-4565-a227-fe43233faf51]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ef211-894a-4553-ac3b-ec54957785f3]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 (non-flash)
Jul 27 10:07:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:07:01 user nova-compute[70374]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 (non-flash)
Jul 27 10:07:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c3b7cb-8d36-4782-adf3-c95d4cb9e154]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thCMFjRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:07:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23763613564633566', 'path': '/dev/sde'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763613564633566', 'path': '/dev/sde'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1570136627',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1570136627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1570136627',id=46,image_ref='fc887a36-66e6-40f8-968c-60a2a7127fa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxdMibcbSSaGteOuJ7EUC30LnxdUWajaomMGkkJCBxcnMpQbH7o0iwRtR0530pQjyVG+ZoJSQklyILYCyIBhA1vDghvyrtu5H8O/kR1aZOwrvR8ur0H9ZRepEu/DYkIuA==',key_name='tempest-keypair-2138961189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-jyqhfz9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-953954878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6e02625621443392a958dd87d679a3',uuid=1a6d2a03-5122-4649-82bc-1fb334bb6e1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e1:d6,bridge_name='br-int',has_traffic_filtering=True,id=2cd7530b-093b-44e6-bee9-e18c17424076,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd7530b-09') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.objects.instance [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a6d2a03-5122-4649-82bc-1fb334bb6e1d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:07:02 user nova-compute[70374]:   <uuid>1a6d2a03-5122-4649-82bc-1fb334bb6e1d</uuid>
Jul 27 10:07:02 user nova-compute[70374]:   <name>instance-0000002e</name>
Jul 27 10:07:02 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:07:02 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:07:02 user nova-compute[70374]:   <metadata>
Jul 27 10:07:02 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:07:02 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:07:02 user nova-compute[70374]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1570136627</nova:name>
Jul 27 10:07:02 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:07:01</nova:creationTime>
Jul 27 10:07:02 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:07:02 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:07:02 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:07:02 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:07:02 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:07:02 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:07:02 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:07:02 user nova-compute[70374]:       <nova:owner>
Jul 27 10:07:02 user nova-compute[70374]:         <nova:user uuid="fc6e02625621443392a958dd87d679a3">tempest-TestVolumeBootPattern-953954878-project-member</nova:user>
Jul 27 10:07:02 user nova-compute[70374]:         <nova:project uuid="52e1ff0e178842deba4c0efce3b84cf8">tempest-TestVolumeBootPattern-953954878</nova:project>
Jul 27 10:07:02 user nova-compute[70374]:       </nova:owner>
Jul 27 10:07:02 user nova-compute[70374]:       <nova:root type="image" uuid="fc887a36-66e6-40f8-968c-60a2a7127fa0"/>
Jul 27 10:07:02 user nova-compute[70374]:       <nova:ports>
Jul 27 10:07:02 user nova-compute[70374]:         <nova:port uuid="2cd7530b-093b-44e6-bee9-e18c17424076">
Jul 27 10:07:02 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 10:07:02 user nova-compute[70374]:         </nova:port>
Jul 27 10:07:02 user nova-compute[70374]:       </nova:ports>
Jul 27 10:07:02 user nova-compute[70374]:     </nova:instance>
Jul 27 10:07:02 user nova-compute[70374]:   </metadata>
Jul 27 10:07:02 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:07:02 user nova-compute[70374]:     <system>
Jul 27 10:07:02 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:07:02 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:07:02 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:07:02 user nova-compute[70374]:       <entry name="serial">1a6d2a03-5122-4649-82bc-1fb334bb6e1d</entry>
Jul 27 10:07:02 user nova-compute[70374]:       <entry name="uuid">1a6d2a03-5122-4649-82bc-1fb334bb6e1d</entry>
Jul 27 10:07:02 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:07:02 user nova-compute[70374]:     </system>
Jul 27 10:07:02 user nova-compute[70374]:   </sysinfo>
Jul 27 10:07:02 user nova-compute[70374]:   <os>
Jul 27 10:07:02 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:07:02 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:07:02 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:07:02 user nova-compute[70374]:   </os>
Jul 27 10:07:02 user nova-compute[70374]:   <features>
Jul 27 10:07:02 user nova-compute[70374]:     <acpi/>
Jul 27 10:07:02 user nova-compute[70374]:     <apic/>
Jul 27 10:07:02 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:07:02 user nova-compute[70374]:   </features>
Jul 27 10:07:02 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:07:02 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:07:02 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:07:02 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:07:02 user nova-compute[70374]:   </clock>
Jul 27 10:07:02 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:07:02 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:07:02 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:07:02 user nova-compute[70374]:   </cpu>
Jul 27 10:07:02 user nova-compute[70374]:   <devices>
Jul 27 10:07:02 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:07:02 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:07:02 user nova-compute[70374]:       <source dev="/dev/sde"/>
Jul 27 10:07:02 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:07:02 user nova-compute[70374]:       <serial>c2f196ab-5041-4c1b-89d7-28310f726f99</serial>
Jul 27 10:07:02 user nova-compute[70374]:     </disk>
Jul 27 10:07:02 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:07:02 user nova-compute[70374]:       <mac address="fa:16:3e:73:e1:d6"/>
Jul 27 10:07:02 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:07:02 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:07:02 user nova-compute[70374]:       <target dev="tap2cd7530b-09"/>
Jul 27 10:07:02 user nova-compute[70374]:     </interface>
Jul 27 10:07:02 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:07:02 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/1a6d2a03-5122-4649-82bc-1fb334bb6e1d/console.log" append="off"/>
Jul 27 10:07:02 user nova-compute[70374]:     </serial>
Jul 27 10:07:02 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:07:02 user nova-compute[70374]:     <video>
Jul 27 10:07:02 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:07:02 user nova-compute[70374]:     </video>
Jul 27 10:07:02 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:07:02 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:07:02 user nova-compute[70374]:     </rng>
Jul 27 10:07:02 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:07:02 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:07:02 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:07:02 user nova-compute[70374]:     </memballoon>
Jul 27 10:07:02 user nova-compute[70374]:   </devices>
Jul 27 10:07:02 user nova-compute[70374]: </domain>
Jul 27 10:07:02 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1570136627',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1570136627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1570136627',id=46,image_ref='fc887a36-66e6-40f8-968c-60a2a7127fa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxdMibcbSSaGteOuJ7EUC30LnxdUWajaomMGkkJCBxcnMpQbH7o0iwRtR0530pQjyVG+ZoJSQklyILYCyIBhA1vDghvyrtu5H8O/kR1aZOwrvR8ur0H9ZRepEu/DYkIuA==',key_name='tempest-keypair-2138961189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-jyqhfz9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-953954878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6e02625621443392a958dd87d679a3',uuid=1a6d2a03-5122-4649-82bc-1fb334bb6e1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e1:d6,bridge_name='br-int',has_traffic_filtering=True,id=2cd7530b-093b-44e6-bee9-e18c17424076,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd7530b-09') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG os_vif [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e1:d6,bridge_name='br-int',has_traffic_filtering=True,id=2cd7530b-093b-44e6-bee9-e18c17424076,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd7530b-09') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cd7530b-09, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cd7530b-09, col_values=(('external_ids', {'iface-id': '2cd7530b-093b-44e6-bee9-e18c17424076', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:e1:d6', 'vm-uuid': '1a6d2a03-5122-4649-82bc-1fb334bb6e1d'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:02 user nova-compute[70374]: INFO os_vif [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e1:d6,bridge_name='br-int',has_traffic_filtering=True,id=2cd7530b-093b-44e6-bee9-e18c17424076,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd7530b-09')
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:07:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No VIF found with MAC fa:16:3e:73:e1:d6, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-71ef8ec1-197b-40c8-b19c-c5532d38980f req-268157c2-f545-4971-ad43-51a999096a60 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received event network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71ef8ec1-197b-40c8-b19c-c5532d38980f req-268157c2-f545-4971-ad43-51a999096a60 service nova] Acquiring lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71ef8ec1-197b-40c8-b19c-c5532d38980f req-268157c2-f545-4971-ad43-51a999096a60 service nova] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71ef8ec1-197b-40c8-b19c-c5532d38980f req-268157c2-f545-4971-ad43-51a999096a60 service nova] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG nova.compute.manager [req-71ef8ec1-197b-40c8-b19c-c5532d38980f req-268157c2-f545-4971-ad43-51a999096a60 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] No waiting events found dispatching network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:07:04 user nova-compute[70374]: WARNING nova.compute.manager [req-71ef8ec1-197b-40c8-b19c-c5532d38980f req-268157c2-f545-4971-ad43-51a999096a60 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received unexpected event network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 for instance with vm_state building and task_state spawning.
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_power_states {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 06b6cb39-6667-4b3e-ba46-ecee8137ab90 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 82ab1f89-71d2-4839-a705-8506aa76eb5d {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 1a6d2a03-5122-4649-82bc-1fb334bb6e1d {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:04 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452426.3386729, 1a6d2a03-5122-4649-82bc-1fb334bb6e1d => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:07:06 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] VM Resumed (Lifecycle Event)
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:07:06 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Instance spawned successfully.
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:07:06 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452426.3432136, 1a6d2a03-5122-4649-82bc-1fb334bb6e1d => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:07:06 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] VM Started (Lifecycle Event)
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-5bbfcdef-4499-4047-a249-5b658853be6e req-18564f49-78c9-4560-bb3d-13159fc32de3 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received event network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5bbfcdef-4499-4047-a249-5b658853be6e req-18564f49-78c9-4560-bb3d-13159fc32de3 service nova] Acquiring lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5bbfcdef-4499-4047-a249-5b658853be6e req-18564f49-78c9-4560-bb3d-13159fc32de3 service nova] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5bbfcdef-4499-4047-a249-5b658853be6e req-18564f49-78c9-4560-bb3d-13159fc32de3 service nova] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.compute.manager [req-5bbfcdef-4499-4047-a249-5b658853be6e req-18564f49-78c9-4560-bb3d-13159fc32de3 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] No waiting events found dispatching network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:07:06 user nova-compute[70374]: WARNING nova.compute.manager [req-5bbfcdef-4499-4047-a249-5b658853be6e req-18564f49-78c9-4560-bb3d-13159fc32de3 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received unexpected event network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 for instance with vm_state building and task_state spawning.
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:07:06 user nova-compute[70374]: INFO nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Took 5.10 seconds to spawn the instance on the hypervisor.
Jul 27 10:07:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:07:06 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:07:06 user nova-compute[70374]: INFO nova.compute.manager [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Took 18.21 seconds to build instance.
Jul 27 10:07:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-758f5410-bf15-42ea-8bf8-e5e7d74c965c tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.318s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.076s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:06 user nova-compute[70374]: INFO nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:07:06 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:08 user nova-compute[70374]: INFO nova.compute.manager [None req-26b775c8-21f2-4a86-ae12-ca9c4ecb65e2 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Unrescuing
Jul 27 10:07:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-26b775c8-21f2-4a86-ae12-ca9c4ecb65e2 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:07:08 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-26b775c8-21f2-4a86-ae12-ca9c4ecb65e2 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquired lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:07:08 user nova-compute[70374]: DEBUG nova.network.neutron [None req-26b775c8-21f2-4a86-ae12-ca9c4ecb65e2 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG nova.network.neutron [None req-26b775c8-21f2-4a86-ae12-ca9c4ecb65e2 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Updating instance_info_cache with network_info: [{"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-26b775c8-21f2-4a86-ae12-ca9c4ecb65e2 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Releasing lock "refresh_cache-918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG nova.objects.instance [None req-26b775c8-21f2-4a86-ae12-ca9c4ecb65e2 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'flavor' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-49fce7f1-17aa-4767-b754-5148d1ee1ba9 req-3b73ef33-76a5-4e81-99bd-06faaa2d6bbf service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-49fce7f1-17aa-4767-b754-5148d1ee1ba9 req-3b73ef33-76a5-4e81-99bd-06faaa2d6bbf service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-49fce7f1-17aa-4767-b754-5148d1ee1ba9 req-3b73ef33-76a5-4e81-99bd-06faaa2d6bbf service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-49fce7f1-17aa-4767-b754-5148d1ee1ba9 req-3b73ef33-76a5-4e81-99bd-06faaa2d6bbf service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG nova.compute.manager [req-49fce7f1-17aa-4767-b754-5148d1ee1ba9 req-3b73ef33-76a5-4e81-99bd-06faaa2d6bbf service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:07:09 user nova-compute[70374]: WARNING nova.compute.manager [req-49fce7f1-17aa-4767-b754-5148d1ee1ba9 req-3b73ef33-76a5-4e81-99bd-06faaa2d6bbf service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state rescued and task_state unrescuing.
Jul 27 10:07:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:10 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance destroyed successfully.
Jul 27 10:07:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:07:11 user nova-compute[70374]: WARNING nova.compute.manager [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state rescued and task_state unrescuing.
Jul 27 10:07:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG nova.compute.manager [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:07:11 user nova-compute[70374]: WARNING nova.compute.manager [req-cfc46249-addd-4780-9a95-1790abca603d req-a31e4867-b901-4fa2-9446-cf6e0ed4f37c service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state rescued and task_state unrescuing.
Jul 27 10:07:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Removed pending event for 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e due to event {{(pid=70374) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452433.6232073, 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:07:13 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] VM Resumed (Lifecycle Event)
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-26b775c8-21f2-4a86-ae12-ca9c4ecb65e2 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:07:13 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452433.6250854, 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:07:13 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] VM Started (Lifecycle Event)
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-b8b5a48a-0d9e-4a44-8200-4bbe83152f7c req-52bbd5ea-46a2-4234-a07c-571825f9f853 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b8b5a48a-0d9e-4a44-8200-4bbe83152f7c req-52bbd5ea-46a2-4234-a07c-571825f9f853 service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b8b5a48a-0d9e-4a44-8200-4bbe83152f7c req-52bbd5ea-46a2-4234-a07c-571825f9f853 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b8b5a48a-0d9e-4a44-8200-4bbe83152f7c req-52bbd5ea-46a2-4234-a07c-571825f9f853 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:13 user nova-compute[70374]: DEBUG nova.compute.manager [req-b8b5a48a-0d9e-4a44-8200-4bbe83152f7c req-52bbd5ea-46a2-4234-a07c-571825f9f853 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:07:13 user nova-compute[70374]: WARNING nova.compute.manager [req-b8b5a48a-0d9e-4a44-8200-4bbe83152f7c req-52bbd5ea-46a2-4234-a07c-571825f9f853 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state active and task_state None.
Jul 27 10:07:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:07:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:07:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:07:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:07:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:07:39 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [{"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:07:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-15c7721e-cebc-4f3a-a214-ea93ef21a80d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:07:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:07:39 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:39 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:07:44 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:07:44 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8319MB free_disk=25.022117614746094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 82ab1f89-71d2-4839-a705-8506aa76eb5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 1a6d2a03-5122-4649-82bc-1fb334bb6e1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:07:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:07:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:46 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:07:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:07:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:07:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:08:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:08:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:08:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:08:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:08:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:08:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:08:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:08:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:08:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:08:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:08:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Updating instance_info_cache with network_info: [{"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:08:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-06b6cb39-6667-4b3e-ba46-ecee8137ab90" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:08:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:08:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-e6d4d1ed-ff61-4cc2-acf9-aab05c218f28 req-324b786a-3d2a-48d3-a609-efde8a459dc7 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received event network-changed-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:08:39 user nova-compute[70374]: DEBUG nova.compute.manager [req-e6d4d1ed-ff61-4cc2-acf9-aab05c218f28 req-324b786a-3d2a-48d3-a609-efde8a459dc7 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Refreshing instance network info cache due to event network-changed-2cd7530b-093b-44e6-bee9-e18c17424076. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:08:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e6d4d1ed-ff61-4cc2-acf9-aab05c218f28 req-324b786a-3d2a-48d3-a609-efde8a459dc7 service nova] Acquiring lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:08:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e6d4d1ed-ff61-4cc2-acf9-aab05c218f28 req-324b786a-3d2a-48d3-a609-efde8a459dc7 service nova] Acquired lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:08:39 user nova-compute[70374]: DEBUG nova.network.neutron [req-e6d4d1ed-ff61-4cc2-acf9-aab05c218f28 req-324b786a-3d2a-48d3-a609-efde8a459dc7 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Refreshing network info cache for port 2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-e6d4d1ed-ff61-4cc2-acf9-aab05c218f28 req-324b786a-3d2a-48d3-a609-efde8a459dc7 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Updated VIF entry in instance network info cache for port 2cd7530b-093b-44e6-bee9-e18c17424076. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG nova.network.neutron [req-e6d4d1ed-ff61-4cc2-acf9-aab05c218f28 req-324b786a-3d2a-48d3-a609-efde8a459dc7 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Updating instance_info_cache with network_info: [{"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e6d4d1ed-ff61-4cc2-acf9-aab05c218f28 req-324b786a-3d2a-48d3-a609-efde8a459dc7 service nova] Releasing lock "refresh_cache-1a6d2a03-5122-4649-82bc-1fb334bb6e1d" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:08:40 user nova-compute[70374]: INFO nova.compute.manager [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Terminating instance
Jul 27 10:08:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-92877d4f-3ee8-4b3a-9ba5-84eeb54f4fa1 req-b13d1afb-3e1b-4670-b5a9-adb3bc7007fd service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received event network-vif-unplugged-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-92877d4f-3ee8-4b3a-9ba5-84eeb54f4fa1 req-b13d1afb-3e1b-4670-b5a9-adb3bc7007fd service nova] Acquiring lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-92877d4f-3ee8-4b3a-9ba5-84eeb54f4fa1 req-b13d1afb-3e1b-4670-b5a9-adb3bc7007fd service nova] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-92877d4f-3ee8-4b3a-9ba5-84eeb54f4fa1 req-b13d1afb-3e1b-4670-b5a9-adb3bc7007fd service nova] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-92877d4f-3ee8-4b3a-9ba5-84eeb54f4fa1 req-b13d1afb-3e1b-4670-b5a9-adb3bc7007fd service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] No waiting events found dispatching network-vif-unplugged-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-92877d4f-3ee8-4b3a-9ba5-84eeb54f4fa1 req-b13d1afb-3e1b-4670-b5a9-adb3bc7007fd service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received event network-vif-unplugged-2cd7530b-093b-44e6-bee9-e18c17424076 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Instance destroyed successfully.
Jul 27 10:08:41 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'resources' on Instance uuid 1a6d2a03-5122-4649-82bc-1fb334bb6e1d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1570136627',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1570136627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1570136627',id=46,image_ref='fc887a36-66e6-40f8-968c-60a2a7127fa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxdMibcbSSaGteOuJ7EUC30LnxdUWajaomMGkkJCBxcnMpQbH7o0iwRtR0530pQjyVG+ZoJSQklyILYCyIBhA1vDghvyrtu5H8O/kR1aZOwrvR8ur0H9ZRepEu/DYkIuA==',key_name='tempest-keypair-2138961189',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:07:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-jyqhfz9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-953954878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6e02625621443392a958dd87d679a3',uuid=1a6d2a03-5122-4649-82bc-1fb334bb6e1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "2cd7530b-093b-44e6-bee9-e18c17424076", "address": "fa:16:3e:73:e1:d6", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd7530b-09", "ovs_interfaceid": "2cd7530b-093b-44e6-bee9-e18c17424076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:e1:d6,bridge_name='br-int',has_traffic_filtering=True,id=2cd7530b-093b-44e6-bee9-e18c17424076,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd7530b-09') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_vif [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e1:d6,bridge_name='br-int',has_traffic_filtering=True,id=2cd7530b-093b-44e6-bee9-e18c17424076,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd7530b-09') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cd7530b-09, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:41 user nova-compute[70374]: INFO os_vif [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e1:d6,bridge_name='br-int',has_traffic_filtering=True,id=2cd7530b-093b-44e6-bee9-e18c17424076,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd7530b-09')
Jul 27 10:08:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thCMFjRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:08:41 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[622dd6af-4ee8-414e-b36a-71dca0b59c96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:08:41 user nova-compute[70374]: No targets found.
Jul 27 10:08:41 user nova-compute[70374]: iSNS:
Jul 27 10:08:41 user nova-compute[70374]: No targets found.
Jul 27 10:08:41 user nova-compute[70374]: STATIC:
Jul 27 10:08:41 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc
Jul 27 10:08:41 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:08:41 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:08:41 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99
Jul 27 10:08:41 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:08:41 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:08:41 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611
Jul 27 10:08:41 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:08:41 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:08:41 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 10:08:41 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:08:41 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:08:41 user nova-compute[70374]: FIRMWARE:
Jul 27 10:08:41 user nova-compute[70374]: No targets found.
Jul 27 10:08:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:08:41 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:08:41 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54eb447-1c4a-41ee-8094-4e7f83c6ad2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d753c85c-ebb0-4686-a119-3c970bd65ada]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:08:41 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:08:41 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:08:41 user nova-compute[70374]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 (non-flash)
Jul 27 10:08:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:08:41 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:08:41 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:08:41 user nova-compute[70374]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 (non-flash)
Jul 27 10:08:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc08dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99'): ({'sde'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Removing single pathed devices sde {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f877a72-e7c4-491e-b7a1-3b2705cfa14c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a45858-1d19-4a3e-b3f1-c6c8f65e3d7c]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flushing IO for device /dev/sde {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e320146e-fe0f-49be-8841-9c1e75f57978]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7217612-b4d1-4bd0-a5e0-2571975356db]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] SCSI volumes sde have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23763613564633566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9ce15976', '/dev/disk/by-id/scsi-1SCST_BIO9ce15976-7ca5dc5faea4d7de') {{(pid=82164) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0500d5c9-8843-4d22-a904-acbcac4e6909]: (4, None) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a91532-adad-4b7c-af21-d2485857eb75]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[87186a05-8e97-4495-bef5-8a30f4d793f9]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99, portal: 172.16.0.220,3260]
Jul 27 10:08:41 user nova-compute[70374]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99, portal: 172.16.0.220,3260] successful.
Jul 27 10:08:41 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2f196ab-5041-4c1b-89d7-28310f726f99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6259b2fa-bcbe-4448-83b7-a60c5bed6c6e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== disconnect_volume: return (347ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:08:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Deleting instance files /opt/stack/data/nova/instances/1a6d2a03-5122-4649-82bc-1fb334bb6e1d_del
Jul 27 10:08:41 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Deletion of /opt/stack/data/nova/instances/1a6d2a03-5122-4649-82bc-1fb334bb6e1d_del complete
Jul 27 10:08:41 user nova-compute[70374]: INFO nova.compute.manager [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 27 10:08:41 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:08:41 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:08:42 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:08:42 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Took 1.05 seconds to deallocate network for instance.
Jul 27 10:08:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-18d9f727-54d2-4d74-8e70-82ad0e3ff534 req-d139dd4b-3303-41f3-874b-601e95c8ba6d service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received event network-vif-deleted-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:08:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-147d7fe5-043b-4bc5-afac-e856fb36254f req-769a5e60-c38d-4608-9b2d-08a85fed60b9 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received event network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:08:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-147d7fe5-043b-4bc5-afac-e856fb36254f req-769a5e60-c38d-4608-9b2d-08a85fed60b9 service nova] Acquiring lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-147d7fe5-043b-4bc5-afac-e856fb36254f req-769a5e60-c38d-4608-9b2d-08a85fed60b9 service nova] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-147d7fe5-043b-4bc5-afac-e856fb36254f req-769a5e60-c38d-4608-9b2d-08a85fed60b9 service nova] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:08:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-147d7fe5-043b-4bc5-afac-e856fb36254f req-769a5e60-c38d-4608-9b2d-08a85fed60b9 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] No waiting events found dispatching network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:08:42 user nova-compute[70374]: WARNING nova.compute.manager [req-147d7fe5-043b-4bc5-afac-e856fb36254f req-769a5e60-c38d-4608-9b2d-08a85fed60b9 service nova] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Received unexpected event network-vif-plugged-2cd7530b-093b-44e6-bee9-e18c17424076 for instance with vm_state active and task_state deleting.
Jul 27 10:08:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:43 user nova-compute[70374]: INFO nova.compute.manager [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Took 0.83 seconds to detach 1 volumes for instance.
Jul 27 10:08:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Deleting volume: c2f196ab-5041-4c1b-89d7-28310f726f99 {{(pid=70374) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 10:08:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:43 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:08:43 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:08:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:08:43 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Deleted allocations for instance 1a6d2a03-5122-4649-82bc-1fb334bb6e1d
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9a7f109e-8165-48cc-9109-b8609e92a08f tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "1a6d2a03-5122-4649-82bc-1fb334bb6e1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.547s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:08:45 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:08:45 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=25.021183013916016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 82ab1f89-71d2-4839-a705-8506aa76eb5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:08:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:08:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:08:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:56 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452521.227844, 1a6d2a03-5122-4649-82bc-1fb334bb6e1d => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:08:56 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] VM Stopped (Lifecycle Event)
Jul 27 10:08:56 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9c975fca-49a3-426a-a06d-de6f5d3fca32 None None] [instance: 1a6d2a03-5122-4649-82bc-1fb334bb6e1d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:08:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:08:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:08:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:08:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:08:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:08:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:08:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:08:59 user nova-compute[70374]: INFO nova.compute.manager [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Terminating instance
Jul 27 10:08:59 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:08:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:08:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.compute.manager [req-220b9e31-0c00-46b5-b15a-4470a775209b req-892feff9-3621-4d7c-9ab9-def6657cadb0 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-220b9e31-0c00-46b5-b15a-4470a775209b req-892feff9-3621-4d7c-9ab9-def6657cadb0 service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-220b9e31-0c00-46b5-b15a-4470a775209b req-892feff9-3621-4d7c-9ab9-def6657cadb0 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-220b9e31-0c00-46b5-b15a-4470a775209b req-892feff9-3621-4d7c-9ab9-def6657cadb0 service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.compute.manager [req-220b9e31-0c00-46b5-b15a-4470a775209b req-892feff9-3621-4d7c-9ab9-def6657cadb0 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.compute.manager [req-220b9e31-0c00-46b5-b15a-4470a775209b req-892feff9-3621-4d7c-9ab9-def6657cadb0 service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-unplugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Instance destroyed successfully.
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'resources' on Instance uuid 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1759550182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1759550182',id=44,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-lh0d7veq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:07:14Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "address": "fa:16:3e:2a:68:18", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04dafcc-e1", "ovs_interfaceid": "b04dafcc-e150-43c9-b4ad-82843e7d8802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:68:18,bridge_name='br-int',has_traffic_filtering=True,id=b04dafcc-e150-43c9-b4ad-82843e7d8802,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04dafcc-e1') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_vif [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:68:18,bridge_name='br-int',has_traffic_filtering=True,id=b04dafcc-e150-43c9-b4ad-82843e7d8802,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04dafcc-e1') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb04dafcc-e1, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:09:00 user nova-compute[70374]: INFO os_vif [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:68:18,bridge_name='br-int',has_traffic_filtering=True,id=b04dafcc-e150-43c9-b4ad-82843e7d8802,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04dafcc-e1')
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlUXnOSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:09:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[396d7bb2-133a-4f99-b922-82f39df9910e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:09:00 user nova-compute[70374]: No targets found.
Jul 27 10:09:00 user nova-compute[70374]: iSNS:
Jul 27 10:09:00 user nova-compute[70374]: No targets found.
Jul 27 10:09:00 user nova-compute[70374]: STATIC:
Jul 27 10:09:00 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc
Jul 27 10:09:00 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:09:00 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:09:00 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611
Jul 27 10:09:00 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:09:00 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:09:00 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 10:09:00 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:09:00 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:09:00 user nova-compute[70374]: FIRMWARE:
Jul 27 10:09:00 user nova-compute[70374]: No targets found.
Jul 27 10:09:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:09:00 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:09:00 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e973ad8c-de68-4481-b85e-20205a498763]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[93457e89-6dae-4ed2-8a8d-1b4580323828]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:09:00 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:09:00 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:09:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:09:00 user nova-compute[70374]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 (non-flash)
Jul 27 10:09:00 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:09:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc0e29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3537f2ed-db92-45a1-bac8-b8d7fc1fe504]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a41f317-9aa2-4106-978f-0405bc6213b6]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b383c4-82fd-4507-8c3c-f1172efa2572]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[222300bb-bcea-4756-bb50-8478e317f55d]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4997b391-cafe-479b-b62e-53862201c445]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[001b5845-2ff5-41be-a2c8-4524006c7fa5]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611, portal: 172.16.0.220,3260]
Jul 27 10:09:00 user nova-compute[70374]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611, portal: 172.16.0.220,3260] successful.
Jul 27 10:09:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d841dfdd-f50e-4e00-829e-1c042a9de611 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[35903f4e-8d31-4676-9d95-ee5667bea931]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] <== disconnect_volume: return (327ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:09:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Deleting instance files /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e_del
Jul 27 10:09:00 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Deletion of /opt/stack/data/nova/instances/918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e_del complete
Jul 27 10:09:00 user nova-compute[70374]: INFO nova.compute.manager [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 27 10:09:00 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:09:00 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:09:01 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:09:01 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Took 0.58 seconds to deallocate network for instance.
Jul 27 10:09:01 user nova-compute[70374]: DEBUG nova.compute.manager [req-b795ddd5-c7ce-4c9a-9811-2fc80b483397 req-5e830b39-f41a-40af-acb8-fba68cea5c6a service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-deleted-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-b21159b4-6594-439d-8171-74378aa29585 req-d62b5968-b0a3-436a-8c0b-f94108e27f9f service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b21159b4-6594-439d-8171-74378aa29585 req-d62b5968-b0a3-436a-8c0b-f94108e27f9f service nova] Acquiring lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b21159b4-6594-439d-8171-74378aa29585 req-d62b5968-b0a3-436a-8c0b-f94108e27f9f service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-b21159b4-6594-439d-8171-74378aa29585 req-d62b5968-b0a3-436a-8c0b-f94108e27f9f service nova] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-b21159b4-6594-439d-8171-74378aa29585 req-d62b5968-b0a3-436a-8c0b-f94108e27f9f service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] No waiting events found dispatching network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:02 user nova-compute[70374]: WARNING nova.compute.manager [req-b21159b4-6594-439d-8171-74378aa29585 req-d62b5968-b0a3-436a-8c0b-f94108e27f9f service nova] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Received unexpected event network-vif-plugged-b04dafcc-e150-43c9-b4ad-82843e7d8802 for instance with vm_state active and task_state deleting.
Jul 27 10:09:02 user nova-compute[70374]: INFO nova.compute.manager [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Took 0.72 seconds to detach 1 volumes for instance.
Jul 27 10:09:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:09:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:02 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Deleted allocations for instance 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e
Jul 27 10:09:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8bb07aed-272e-49a2-a32d-b781fff9ff68 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.865s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:09:15 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452540.5611236, 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:09:15 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] VM Stopped (Lifecycle Event)
Jul 27 10:09:15 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6db09815-e76f-40b9-abb0-befc36cedc2f None None] [instance: 918fd3c5-05a9-48c1-bbc1-9c9b2de1d71e] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:09:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:09:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:09:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:09:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:09:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:09:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:35 user nova-compute[70374]: INFO nova.compute.manager [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Terminating instance
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c8e5ef06-92c5-4e6d-aae3-528ac86ec40f req-26aa36c0-bca8-4086-838c-fc17fe9e8f64 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received event network-vif-unplugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c8e5ef06-92c5-4e6d-aae3-528ac86ec40f req-26aa36c0-bca8-4086-838c-fc17fe9e8f64 service nova] Acquiring lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c8e5ef06-92c5-4e6d-aae3-528ac86ec40f req-26aa36c0-bca8-4086-838c-fc17fe9e8f64 service nova] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c8e5ef06-92c5-4e6d-aae3-528ac86ec40f req-26aa36c0-bca8-4086-838c-fc17fe9e8f64 service nova] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c8e5ef06-92c5-4e6d-aae3-528ac86ec40f req-26aa36c0-bca8-4086-838c-fc17fe9e8f64 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] No waiting events found dispatching network-vif-unplugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-c8e5ef06-92c5-4e6d-aae3-528ac86ec40f req-26aa36c0-bca8-4086-838c-fc17fe9e8f64 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received event network-vif-unplugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Instance destroyed successfully.
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'resources' on Instance uuid 82ab1f89-71d2-4839-a705-8506aa76eb5d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-30299694',display_name='tempest-TestVolumeBootPattern-volume-backed-server-30299694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-30299694',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuQQ9rsLV9jDcGbtoO9mK6R0DQg35dOjVqsd1roR7izgFL1hk6PmTvEBah2v9rMFxltQIRSkVEh6R97FxStORSpzmnpRTNPYgsQ1eQahJ7OukcI1U44Dclq0jdTCMyN2A==',key_name='tempest-keypair-703067748',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-wh4edhhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6e02625621443392a958dd87d679a3',uuid=82ab1f89-71d2-4839-a705-8506aa76eb5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "address": "fa:16:3e:f9:c9:ec", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a0f200-bc", "ovs_interfaceid": "b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:c9:ec,bridge_name='br-int',has_traffic_filtering=True,id=b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a0f200-bc') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG os_vif [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:c9:ec,bridge_name='br-int',has_traffic_filtering=True,id=b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a0f200-bc') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4a0f200-bc, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:09:35 user nova-compute[70374]: INFO os_vif [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:c9:ec,bridge_name='br-int',has_traffic_filtering=True,id=b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a0f200-bc')
Jul 27 10:09:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFkKISVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:09:35 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:09:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:09:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[af85e26a-2b45-4540-8aff-58e941fafa2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:09:36 user nova-compute[70374]: No targets found.
Jul 27 10:09:36 user nova-compute[70374]: iSNS:
Jul 27 10:09:36 user nova-compute[70374]: No targets found.
Jul 27 10:09:36 user nova-compute[70374]: STATIC:
Jul 27 10:09:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc
Jul 27 10:09:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:09:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:09:36 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 10:09:36 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:09:36 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:09:36 user nova-compute[70374]: FIRMWARE:
Jul 27 10:09:36 user nova-compute[70374]: No targets found.
Jul 27 10:09:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:09:36 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:09:36 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d83f03-084f-42c1-96ff-5a54b8195367]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b2c6f2-4bb0-4711-bee7-f4a2f09bd1e9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:09:36 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:09:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:09:36 user nova-compute[70374]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc (non-flash)
Jul 27 10:09:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc0e2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cd554d-7f5b-4ee2-b039-e6730a02df7e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c008ee-e20a-456b-9d3d-27534b379731]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2bca95-ed7d-4ddc-b4ec-f72f67d31c58]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[89701eb2-b0b4-4d62-82cb-3b63c691bdcd]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23665626463633139', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ea184406', '/dev/disk/by-id/scsi-1SCST_BIOea184406-6ebdcc1916b7cad7') {{(pid=82164) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d16f1-ecc1-4387-a95b-f0fb99bd262a]: (4, None) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[60883053-8eda-4868-9d7f-3192eb40d91f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5457f0ce-f496-49e2-a14b-fe9e29088bd7]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc, portal: 172.16.0.220,3260]
Jul 27 10:09:36 user nova-compute[70374]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc, portal: 172.16.0.220,3260] successful.
Jul 27 10:09:36 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224d01fb-2958-40d7-9265-711218e28cdc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc789d5a-8c48-4aeb-9d9d-173a505e6569]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== disconnect_volume: return (358ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:09:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Deleting instance files /opt/stack/data/nova/instances/82ab1f89-71d2-4839-a705-8506aa76eb5d_del
Jul 27 10:09:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Deletion of /opt/stack/data/nova/instances/82ab1f89-71d2-4839-a705-8506aa76eb5d_del complete
Jul 27 10:09:36 user nova-compute[70374]: INFO nova.compute.manager [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 27 10:09:36 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:09:36 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:09:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-3672f7ea-b834-4c89-850d-cf41ee05b46c req-387a382d-839f-403c-9203-3b0f68507a50 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received event network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3672f7ea-b834-4c89-850d-cf41ee05b46c req-387a382d-839f-403c-9203-3b0f68507a50 service nova] Acquiring lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3672f7ea-b834-4c89-850d-cf41ee05b46c req-387a382d-839f-403c-9203-3b0f68507a50 service nova] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3672f7ea-b834-4c89-850d-cf41ee05b46c req-387a382d-839f-403c-9203-3b0f68507a50 service nova] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-3672f7ea-b834-4c89-850d-cf41ee05b46c req-387a382d-839f-403c-9203-3b0f68507a50 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] No waiting events found dispatching network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:37 user nova-compute[70374]: WARNING nova.compute.manager [req-3672f7ea-b834-4c89-850d-cf41ee05b46c req-387a382d-839f-403c-9203-3b0f68507a50 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received unexpected event network-vif-plugged-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e for instance with vm_state active and task_state deleting.
Jul 27 10:09:37 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:09:37 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Took 1.30 seconds to deallocate network for instance.
Jul 27 10:09:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-b602bf0a-d835-4121-a1f7-dd3bc690bc77 req-8b5138ae-816e-465f-81b1-420b37f241d1 service nova] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Received event network-vif-deleted-b4a0f200-bc76-4a1a-9f94-097a7ec0dc7e {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Skipping network cache update for instance because it is being deleted. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:38 user nova-compute[70374]: INFO nova.compute.manager [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Took 0.87 seconds to detach 1 volumes for instance.
Jul 27 10:09:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Deleting volume: 224d01fb-2958-40d7-9265-711218e28cdc {{(pid=70374) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:09:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:38 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Deleted allocations for instance 82ab1f89-71d2-4839-a705-8506aa76eb5d
Jul 27 10:09:39 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b5572ca-6f32-4afd-82b7-9fdb0039acd3 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "82ab1f89-71d2-4839-a705-8506aa76eb5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.895s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:40 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:42 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:09:45 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:09:45 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8661MB free_disk=25.02002716064453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:09:46 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:48 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:50 user nova-compute[70374]: INFO nova.compute.manager [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Terminating instance
Jul 27 10:09:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452575.9424791, 82ab1f89-71d2-4839-a705-8506aa76eb5d => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:09:50 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] VM Stopped (Lifecycle Event)
Jul 27 10:09:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-6a8b1628-f079-4c3c-8170-e07e907fb873 None None] [instance: 82ab1f89-71d2-4839-a705-8506aa76eb5d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:09:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-1cbd551e-fc9f-4cb0-841a-2d3b6641a4f7 req-5bb560c4-477c-4904-98ba-fa4943b5fbfe service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-unplugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1cbd551e-fc9f-4cb0-841a-2d3b6641a4f7 req-5bb560c4-477c-4904-98ba-fa4943b5fbfe service nova] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1cbd551e-fc9f-4cb0-841a-2d3b6641a4f7 req-5bb560c4-477c-4904-98ba-fa4943b5fbfe service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-1cbd551e-fc9f-4cb0-841a-2d3b6641a4f7 req-5bb560c4-477c-4904-98ba-fa4943b5fbfe service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-1cbd551e-fc9f-4cb0-841a-2d3b6641a4f7 req-5bb560c4-477c-4904-98ba-fa4943b5fbfe service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] No waiting events found dispatching network-vif-unplugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-1cbd551e-fc9f-4cb0-841a-2d3b6641a4f7 req-5bb560c4-477c-4904-98ba-fa4943b5fbfe service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-unplugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Instance destroyed successfully.
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.objects.instance [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'resources' on Instance uuid 06b6cb39-6667-4b3e-ba46-ecee8137ab90 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1640255479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1640255479',id=42,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-u8src55d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:02:26Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=06b6cb39-6667-4b3e-ba46-ecee8137ab90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "address": "fa:16:3e:1e:e3:94", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f27e3-ba", "ovs_interfaceid": "818f27e3-bad0-4a0b-9af1-32bd4da1c1c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:e3:94,bridge_name='br-int',has_traffic_filtering=True,id=818f27e3-bad0-4a0b-9af1-32bd4da1c1c4,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f27e3-ba') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG os_vif [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:e3:94,bridge_name='br-int',has_traffic_filtering=True,id=818f27e3-bad0-4a0b-9af1-32bd4da1c1c4,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f27e3-ba') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap818f27e3-ba, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:09:51 user nova-compute[70374]: INFO os_vif [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:e3:94,bridge_name='br-int',has_traffic_filtering=True,id=818f27e3-bad0-4a0b-9af1-32bd4da1c1c4,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f27e3-ba')
Jul 27 10:09:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Deleting instance files /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90_del
Jul 27 10:09:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Deletion of /opt/stack/data/nova/instances/06b6cb39-6667-4b3e-ba46-ecee8137ab90_del complete
Jul 27 10:09:51 user nova-compute[70374]: INFO nova.compute.manager [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Took 0.65 seconds to destroy the instance on the hypervisor.
Jul 27 10:09:51 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:09:51 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Took 0.63 seconds to deallocate network for instance.
Jul 27 10:09:51 user nova-compute[70374]: DEBUG nova.compute.manager [req-c625ce0c-cc52-4752-a842-f89a9d920b47 req-fd26285d-93a2-49b1-8adc-8a064f6ce255 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-deleted-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:52 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:09:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:09:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:52 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Deleted allocations for instance 06b6cb39-6667-4b3e-ba46-ecee8137ab90
Jul 27 10:09:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-f40be4d5-7ae8-4aad-8294-e33136b575b9 tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.611s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] No waiting events found dispatching network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:53 user nova-compute[70374]: WARNING nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received unexpected event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 for instance with vm_state deleted and task_state None.
Jul 27 10:09:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] No waiting events found dispatching network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:53 user nova-compute[70374]: WARNING nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received unexpected event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 for instance with vm_state deleted and task_state None.
Jul 27 10:09:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] No waiting events found dispatching network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:53 user nova-compute[70374]: WARNING nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received unexpected event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 for instance with vm_state deleted and task_state None.
Jul 27 10:09:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Acquiring lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] Lock "06b6cb39-6667-4b3e-ba46-ecee8137ab90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:09:53 user nova-compute[70374]: DEBUG nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] No waiting events found dispatching network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:09:53 user nova-compute[70374]: WARNING nova.compute.manager [req-5e675e83-3e41-48b0-9697-ac855c7db2b9 req-e34b87ff-d763-437b-a4cf-316609bde248 service nova] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Received unexpected event network-vif-plugged-818f27e3-bad0-4a0b-9af1-32bd4da1c1c4 for instance with vm_state deleted and task_state None.
Jul 27 10:09:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:10:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:06 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452591.1935976, 06b6cb39-6667-4b3e-ba46-ecee8137ab90 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:10:06 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] VM Stopped (Lifecycle Event)
Jul 27 10:10:06 user nova-compute[70374]: DEBUG nova.compute.manager [None req-83c49b4f-3be8-45e0-b7c2-a2d9ea32e333 None None] [instance: 06b6cb39-6667-4b3e-ba46-ecee8137ab90] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:10:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:10:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:10:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:10:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:10:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:10:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:10:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:10:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:10:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:10:35 user nova-compute[70374]: INFO nova.compute.claims [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Claim successful on node user
Jul 27 10:10:36 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:10:36 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:10:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:36 user nova-compute[70374]: INFO nova.virt.block_device [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Booting with volume 2852526d-fbf1-422b-bcf9-224b87411506 at /dev/vda
Jul 27 10:10:36 user nova-compute[70374]: DEBUG os_brick.utils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG nova.policy [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6e02625621443392a958dd87d679a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e1ff0e178842deba4c0efce3b84cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88af942-f6b4-4170-a039-c789587e59e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7f7c6-dc98-4bd2-a4c0-6b5610fc7f95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[87af45a5-aa1f-4062-b7bd-dd9f655aae2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a08a275-bd5e-4a69-baa5-9cb678483d53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:10:36 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:10:36 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[06836a45-a805-43e8-8514-a9bb267378ce]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG os_brick.utils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:10:36 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Updating existing volume attachment record: b2accc89-f45d-4ca1-84df-625ccb992c31 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:10:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Successfully created port: 7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:10:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Successfully updated port: 7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:10:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:10:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquired lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:10:37 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:10:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-85f0d5a4-eb52-4971-824d-5b26ffcf1c4e req-4214d48b-52a0-4d4d-9cf4-fc03731de6a6 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received event network-changed-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:10:37 user nova-compute[70374]: DEBUG nova.compute.manager [req-85f0d5a4-eb52-4971-824d-5b26ffcf1c4e req-4214d48b-52a0-4d4d-9cf4-fc03731de6a6 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Refreshing instance network info cache due to event network-changed-7e12303f-2b34-4514-950b-88e9d148d499. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:10:37 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-85f0d5a4-eb52-4971-824d-5b26ffcf1c4e req-4214d48b-52a0-4d4d-9cf4-fc03731de6a6 service nova] Acquiring lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Updating instance_info_cache with network_info: [{"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Releasing lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Instance network_info: |[{"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-85f0d5a4-eb52-4971-824d-5b26ffcf1c4e req-4214d48b-52a0-4d4d-9cf4-fc03731de6a6 service nova] Acquired lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-85f0d5a4-eb52-4971-824d-5b26ffcf1c4e req-4214d48b-52a0-4d4d-9cf4-fc03731de6a6 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Refreshing network info cache for port 7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Skipping network cache update for instance because it is Building. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-85f0d5a4-eb52-4971-824d-5b26ffcf1c4e req-4214d48b-52a0-4d4d-9cf4-fc03731de6a6 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Updated VIF entry in instance network info cache for port 7e12303f-2b34-4514-950b-88e9d148d499. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.network.neutron [req-85f0d5a4-eb52-4971-824d-5b26ffcf1c4e req-4214d48b-52a0-4d4d-9cf4-fc03731de6a6 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Updating instance_info_cache with network_info: [{"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-85f0d5a4-eb52-4971-824d-5b26ffcf1c4e req-4214d48b-52a0-4d4d-9cf4-fc03731de6a6 service nova] Releasing lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [{"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-ffe6d95c-b6cd-4d0b-a276-553b0800c630" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:10:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:10:39 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:41 user nova-compute[70374]: INFO nova.compute.manager [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Terminating instance
Jul 27 10:10:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-e43dc95d-f18d-4132-9b93-5350df253df1 req-d794f0c9-3880-4b48-8e4e-1ea3b7838931 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e43dc95d-f18d-4132-9b93-5350df253df1 req-d794f0c9-3880-4b48-8e4e-1ea3b7838931 service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e43dc95d-f18d-4132-9b93-5350df253df1 req-d794f0c9-3880-4b48-8e4e-1ea3b7838931 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e43dc95d-f18d-4132-9b93-5350df253df1 req-d794f0c9-3880-4b48-8e4e-1ea3b7838931 service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-e43dc95d-f18d-4132-9b93-5350df253df1 req-d794f0c9-3880-4b48-8e4e-1ea3b7838931 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG nova.compute.manager [req-e43dc95d-f18d-4132-9b93-5350df253df1 req-d794f0c9-3880-4b48-8e4e-1ea3b7838931 service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-unplugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Instance destroyed successfully.
Jul 27 10:10:42 user nova-compute[70374]: DEBUG nova.objects.instance [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'resources' on Instance uuid 15c7721e-cebc-4f3a-a214-ea93ef21a80d {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1910797450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1910797450',id=38,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-62bd6028',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:58:42Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=15c7721e-cebc-4f3a-a214-ea93ef21a80d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "0de024ba-70c5-4ed4-b007-aaa78b431855", "address": "fa:16:3e:b3:c1:64", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de024ba-70", "ovs_interfaceid": "0de024ba-70c5-4ed4-b007-aaa78b431855", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c1:64,bridge_name='br-int',has_traffic_filtering=True,id=0de024ba-70c5-4ed4-b007-aaa78b431855,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de024ba-70') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_vif [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c1:64,bridge_name='br-int',has_traffic_filtering=True,id=0de024ba-70c5-4ed4-b007-aaa78b431855,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de024ba-70') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0de024ba-70, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:42 user nova-compute[70374]: INFO os_vif [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:c1:64,bridge_name='br-int',has_traffic_filtering=True,id=0de024ba-70c5-4ed4-b007-aaa78b431855,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de024ba-70')
Jul 27 10:10:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTeVNkLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:10:42 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02e0921-5f17-4154-a929-ff951f0ef354]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:10:42 user nova-compute[70374]: No targets found.
Jul 27 10:10:42 user nova-compute[70374]: iSNS:
Jul 27 10:10:42 user nova-compute[70374]: No targets found.
Jul 27 10:10:42 user nova-compute[70374]: STATIC:
Jul 27 10:10:42 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d
Jul 27 10:10:42 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:10:42 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:10:42 user nova-compute[70374]: FIRMWARE:
Jul 27 10:10:42 user nova-compute[70374]: No targets found.
Jul 27 10:10:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:10:42 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:10:42 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[46676b1d-f90a-4a39-97c8-01bd72d424b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f6ec2-f410-4f78-a89f-cecbaedccbed]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:10:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d (non-flash)
Jul 27 10:10:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc4bb520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[47768b53-667a-4856-a608-4b5fc1e353b9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f31a510-0881-4d82-8e52-94569e1f9683]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd563a2-443f-4600-b2ef-50439a3828ee]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd101651-9790-40a8-9025-712e7a120729]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f428d-1f7d-45c4-8b14-83d17f32eeaf]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd760a28-4f82-499b-96ca-5c63d45381fb]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d, portal: 172.16.0.220,3260]
Jul 27 10:10:42 user nova-compute[70374]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d, portal: 172.16.0.220,3260] successful.
Jul 27 10:10:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2eac07e-e7d4-4262-b19d-239eae23984d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e8d523-fae9-4395-993c-0ae8a8f907b0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] <== disconnect_volume: return (296ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:10:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Deleting instance files /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d_del
Jul 27 10:10:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Deletion of /opt/stack/data/nova/instances/15c7721e-cebc-4f3a-a214-ea93ef21a80d_del complete
Jul 27 10:10:42 user nova-compute[70374]: INFO nova.compute.manager [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Took 1.28 seconds to destroy the instance on the hypervisor.
Jul 27 10:10:42 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:10:42 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:10:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Creating image(s)
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Ensure instance console log exists: /opt/stack/data/nova/instances/e0a45e75-b7d0-401d-8472-9eabc8de2e9c/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Start _get_guest_xml network_info=[{"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'b2accc89-f45d-4ca1-84df-625ccb992c31', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyclJSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e0a45e75-b7d0-401d-8472-9eabc8de2e9c', 'attached_at': '', 'detached_at': '', 'volume_id': '2852526d-fbf1-422b-bcf9-224b87411506', 'serial': '2852526d-fbf1-422b-bcf9-224b87411506'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:10:43 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:10:43 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyclJSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:10:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:10:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:10:43 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:10:43 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Took 0.58 seconds to deallocate network for instance.
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab1c8d-1a51-4ebb-b05b-3981df2adad2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:10:43 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1e411e-3535-454c-95c8-0d14d7fd1bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506] added
Jul 27 10:10:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[398b09db-7b80-4e79-987e-67cbc0461c45]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5418d0c5-90bd-4bfa-85d5-07121e74fd28]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUyclJSM {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUyclJSM" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb02348-baeb-4365-8a38-dbf0a067e359]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUyclJSM'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b5f75-4d9d-42ac-951e-a9309c1ed839]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d842d-8100-4ea4-871a-8baf91f8e2a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:10:43 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:10:43 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:10:43 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 10:10:43 user nova-compute[70374]: 
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f52923-dff1-431c-85d8-de1e56d35294]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260]
Jul 27 10:10:43 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260] successful.
Jul 27 10:10:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a47951f-bad2-4381-a85b-d15d86b492d2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5946aa-e7e2-4a53-9774-c1282d84216b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:10:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:10:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5cebe4-88ff-4018-a959-d5455ee7aed0]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyclJSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-c6172cc2-4739-4d31-be42-723c2d82af56 req-d33db60e-2677-423f-94c2-3be981b2b4df service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6172cc2-4739-4d31-be42-723c2d82af56 req-d33db60e-2677-423f-94c2-3be981b2b4df service nova] Acquiring lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6172cc2-4739-4d31-be42-723c2d82af56 req-d33db60e-2677-423f-94c2-3be981b2b4df service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c6172cc2-4739-4d31-be42-723c2d82af56 req-d33db60e-2677-423f-94c2-3be981b2b4df service nova] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-c6172cc2-4739-4d31-be42-723c2d82af56 req-d33db60e-2677-423f-94c2-3be981b2b4df service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] No waiting events found dispatching network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:10:43 user nova-compute[70374]: WARNING nova.compute.manager [req-c6172cc2-4739-4d31-be42-723c2d82af56 req-d33db60e-2677-423f-94c2-3be981b2b4df service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received unexpected event network-vif-plugged-0de024ba-70c5-4ed4-b007-aaa78b431855 for instance with vm_state active and task_state deleting.
Jul 27 10:10:43 user nova-compute[70374]: DEBUG nova.compute.manager [req-c6172cc2-4739-4d31-be42-723c2d82af56 req-d33db60e-2677-423f-94c2-3be981b2b4df service nova] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Received event network-vif-deleted-0de024ba-70c5-4ed4-b007-aaa78b431855 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:10:43 user nova-compute[70374]: INFO nova.compute.manager [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Took 0.75 seconds to detach 1 volumes for instance.
Jul 27 10:10:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:44 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Deleted allocations for instance 15c7721e-cebc-4f3a-a214-ea93ef21a80d
Jul 27 10:10:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-4e876cb4-406a-49ca-b40a-aa69712c867b tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "15c7721e-cebc-4f3a-a214-ea93ef21a80d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.950s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26533633935343636', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633935343636', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007385300',display_name='tempest-TestVolumeBootPattern-server-1007385300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1007385300',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-6f75pxxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:10:36Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=e0a45e75-b7d0-401d-8472-9eabc8de2e9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e12303f-2b34-4514-950b-88e9d148d499,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e12303f-2b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'pci_devices' on Instance uuid e0a45e75-b7d0-401d-8472-9eabc8de2e9c {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:10:44 user nova-compute[70374]:   <uuid>e0a45e75-b7d0-401d-8472-9eabc8de2e9c</uuid>
Jul 27 10:10:44 user nova-compute[70374]:   <name>instance-0000002f</name>
Jul 27 10:10:44 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:10:44 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:10:44 user nova-compute[70374]:   <metadata>
Jul 27 10:10:44 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:10:44 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:10:44 user nova-compute[70374]:       <nova:name>tempest-TestVolumeBootPattern-server-1007385300</nova:name>
Jul 27 10:10:44 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:10:43</nova:creationTime>
Jul 27 10:10:44 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:10:44 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:10:44 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:10:44 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:10:44 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:10:44 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:10:44 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:10:44 user nova-compute[70374]:       <nova:owner>
Jul 27 10:10:44 user nova-compute[70374]:         <nova:user uuid="fc6e02625621443392a958dd87d679a3">tempest-TestVolumeBootPattern-953954878-project-member</nova:user>
Jul 27 10:10:44 user nova-compute[70374]:         <nova:project uuid="52e1ff0e178842deba4c0efce3b84cf8">tempest-TestVolumeBootPattern-953954878</nova:project>
Jul 27 10:10:44 user nova-compute[70374]:       </nova:owner>
Jul 27 10:10:44 user nova-compute[70374]:       <nova:ports>
Jul 27 10:10:44 user nova-compute[70374]:         <nova:port uuid="7e12303f-2b34-4514-950b-88e9d148d499">
Jul 27 10:10:44 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 10:10:44 user nova-compute[70374]:         </nova:port>
Jul 27 10:10:44 user nova-compute[70374]:       </nova:ports>
Jul 27 10:10:44 user nova-compute[70374]:     </nova:instance>
Jul 27 10:10:44 user nova-compute[70374]:   </metadata>
Jul 27 10:10:44 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:10:44 user nova-compute[70374]:     <system>
Jul 27 10:10:44 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:10:44 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:10:44 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:10:44 user nova-compute[70374]:       <entry name="serial">e0a45e75-b7d0-401d-8472-9eabc8de2e9c</entry>
Jul 27 10:10:44 user nova-compute[70374]:       <entry name="uuid">e0a45e75-b7d0-401d-8472-9eabc8de2e9c</entry>
Jul 27 10:10:44 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:10:44 user nova-compute[70374]:     </system>
Jul 27 10:10:44 user nova-compute[70374]:   </sysinfo>
Jul 27 10:10:44 user nova-compute[70374]:   <os>
Jul 27 10:10:44 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:10:44 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:10:44 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:10:44 user nova-compute[70374]:   </os>
Jul 27 10:10:44 user nova-compute[70374]:   <features>
Jul 27 10:10:44 user nova-compute[70374]:     <acpi/>
Jul 27 10:10:44 user nova-compute[70374]:     <apic/>
Jul 27 10:10:44 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:10:44 user nova-compute[70374]:   </features>
Jul 27 10:10:44 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:10:44 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:10:44 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:10:44 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:10:44 user nova-compute[70374]:   </clock>
Jul 27 10:10:44 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:10:44 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:10:44 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:10:44 user nova-compute[70374]:   </cpu>
Jul 27 10:10:44 user nova-compute[70374]:   <devices>
Jul 27 10:10:44 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:10:44 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:10:44 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 10:10:44 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:10:44 user nova-compute[70374]:       <serial>2852526d-fbf1-422b-bcf9-224b87411506</serial>
Jul 27 10:10:44 user nova-compute[70374]:     </disk>
Jul 27 10:10:44 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:10:44 user nova-compute[70374]:       <mac address="fa:16:3e:a2:2b:c8"/>
Jul 27 10:10:44 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:10:44 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:10:44 user nova-compute[70374]:       <target dev="tap7e12303f-2b"/>
Jul 27 10:10:44 user nova-compute[70374]:     </interface>
Jul 27 10:10:44 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:10:44 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/e0a45e75-b7d0-401d-8472-9eabc8de2e9c/console.log" append="off"/>
Jul 27 10:10:44 user nova-compute[70374]:     </serial>
Jul 27 10:10:44 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:10:44 user nova-compute[70374]:     <video>
Jul 27 10:10:44 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:10:44 user nova-compute[70374]:     </video>
Jul 27 10:10:44 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:10:44 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:10:44 user nova-compute[70374]:     </rng>
Jul 27 10:10:44 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:10:44 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:10:44 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:10:44 user nova-compute[70374]:     </memballoon>
Jul 27 10:10:44 user nova-compute[70374]:   </devices>
Jul 27 10:10:44 user nova-compute[70374]: </domain>
Jul 27 10:10:44 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007385300',display_name='tempest-TestVolumeBootPattern-server-1007385300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1007385300',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-6f75pxxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:10:36Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=e0a45e75-b7d0-401d-8472-9eabc8de2e9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e12303f-2b34-4514-950b-88e9d148d499,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e12303f-2b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG os_vif [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e12303f-2b34-4514-950b-88e9d148d499,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e12303f-2b') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e12303f-2b, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e12303f-2b, col_values=(('external_ids', {'iface-id': '7e12303f-2b34-4514-950b-88e9d148d499', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:2b:c8', 'vm-uuid': 'e0a45e75-b7d0-401d-8472-9eabc8de2e9c'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:44 user nova-compute[70374]: INFO os_vif [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e12303f-2b34-4514-950b-88e9d148d499,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e12303f-2b')
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:10:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No VIF found with MAC fa:16:3e:a2:2b:c8, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:10:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-2b065977-0825-483e-9697-68089a903abb req-cb23fdd0-182a-4fd6-99a2-e2c6b8e1d0f4 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received event network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b065977-0825-483e-9697-68089a903abb req-cb23fdd0-182a-4fd6-99a2-e2c6b8e1d0f4 service nova] Acquiring lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b065977-0825-483e-9697-68089a903abb req-cb23fdd0-182a-4fd6-99a2-e2c6b8e1d0f4 service nova] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2b065977-0825-483e-9697-68089a903abb req-cb23fdd0-182a-4fd6-99a2-e2c6b8e1d0f4 service nova] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG nova.compute.manager [req-2b065977-0825-483e-9697-68089a903abb req-cb23fdd0-182a-4fd6-99a2-e2c6b8e1d0f4 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] No waiting events found dispatching network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:10:46 user nova-compute[70374]: WARNING nova.compute.manager [req-2b065977-0825-483e-9697-68089a903abb req-cb23fdd0-182a-4fd6-99a2-e2c6b8e1d0f4 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received unexpected event network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 for instance with vm_state building and task_state spawning.
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:10:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:10:47 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:10:47 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:10:47 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=25.14319610595703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance ffe6d95c-b6cd-4d0b-a276-553b0800c630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance e0a45e75-b7d0-401d-8472-9eabc8de2e9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:10:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452648.0848005, e0a45e75-b7d0-401d-8472-9eabc8de2e9c => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:10:48 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] VM Resumed (Lifecycle Event)
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:10:48 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Instance spawned successfully.
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-31845d1f-6828-4603-928a-b6f3ab1d5aac req-ea4e4f01-05ee-41a0-af87-3ca7edc9dc4a service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received event network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-31845d1f-6828-4603-928a-b6f3ab1d5aac req-ea4e4f01-05ee-41a0-af87-3ca7edc9dc4a service nova] Acquiring lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-31845d1f-6828-4603-928a-b6f3ab1d5aac req-ea4e4f01-05ee-41a0-af87-3ca7edc9dc4a service nova] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-31845d1f-6828-4603-928a-b6f3ab1d5aac req-ea4e4f01-05ee-41a0-af87-3ca7edc9dc4a service nova] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.compute.manager [req-31845d1f-6828-4603-928a-b6f3ab1d5aac req-ea4e4f01-05ee-41a0-af87-3ca7edc9dc4a service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] No waiting events found dispatching network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:10:48 user nova-compute[70374]: WARNING nova.compute.manager [req-31845d1f-6828-4603-928a-b6f3ab1d5aac req-ea4e4f01-05ee-41a0-af87-3ca7edc9dc4a service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received unexpected event network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 for instance with vm_state building and task_state spawning.
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:10:48 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452648.086101, e0a45e75-b7d0-401d-8472-9eabc8de2e9c => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:10:48 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] VM Started (Lifecycle Event)
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:10:48 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:10:48 user nova-compute[70374]: INFO nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Took 5.10 seconds to spawn the instance on the hypervisor.
Jul 27 10:10:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:10:48 user nova-compute[70374]: INFO nova.compute.manager [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Took 12.50 seconds to build instance.
Jul 27 10:10:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a7f8f306-a6d7-490f-ae85-27d703aebf4a tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.628s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:10:48 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:10:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:10:57 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452642.210602, 15c7721e-cebc-4f3a-a214-ea93ef21a80d => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:10:57 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] VM Stopped (Lifecycle Event)
Jul 27 10:10:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-fd1548c1-2b83-4146-a83d-fdac93692886 None None] [instance: 15c7721e-cebc-4f3a-a214-ea93ef21a80d] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:10:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:11:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:11:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:11:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:11:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:11:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:11:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:11:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:11:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:11:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:11:32 user nova-compute[70374]: INFO nova.compute.manager [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Terminating instance
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-390bd442-0bcf-423a-8274-e74e9ec55e2e req-2f3a7d4b-230e-4384-a2e5-532f5f738c9f service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received event network-vif-unplugged-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-390bd442-0bcf-423a-8274-e74e9ec55e2e req-2f3a7d4b-230e-4384-a2e5-532f5f738c9f service nova] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-390bd442-0bcf-423a-8274-e74e9ec55e2e req-2f3a7d4b-230e-4384-a2e5-532f5f738c9f service nova] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-390bd442-0bcf-423a-8274-e74e9ec55e2e req-2f3a7d4b-230e-4384-a2e5-532f5f738c9f service nova] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-390bd442-0bcf-423a-8274-e74e9ec55e2e req-2f3a7d4b-230e-4384-a2e5-532f5f738c9f service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] No waiting events found dispatching network-vif-unplugged-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-390bd442-0bcf-423a-8274-e74e9ec55e2e req-2f3a7d4b-230e-4384-a2e5-532f5f738c9f service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received event network-vif-unplugged-73c76a81-a04f-4f93-9293-d1821de55355 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Instance destroyed successfully.
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.objects.instance [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lazy-loading 'resources' on Instance uuid ffe6d95c-b6cd-4d0b-a276-553b0800c630 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T09:51:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1030901814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1030901814',id=37,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T09:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15442b359a014219b7854237eaaad0d3',ramdisk_id='',reservation_id='r-680chxlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T09:53:54Z,user_data=None,user_id='653bb45e82be4371b55519bbf5308711',uuid=ffe6d95c-b6cd-4d0b-a276-553b0800c630,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converting VIF {"id": "73c76a81-a04f-4f93-9293-d1821de55355", "address": "fa:16:3e:59:aa:06", "network": {"id": "2b856a3a-7704-4076-840c-e16ea49f7cab", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1657386103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15442b359a014219b7854237eaaad0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c76a81-a0", "ovs_interfaceid": "73c76a81-a04f-4f93-9293-d1821de55355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:aa:06,bridge_name='br-int',has_traffic_filtering=True,id=73c76a81-a04f-4f93-9293-d1821de55355,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c76a81-a0') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG os_vif [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:aa:06,bridge_name='br-int',has_traffic_filtering=True,id=73c76a81-a04f-4f93-9293-d1821de55355,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c76a81-a0') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73c76a81-a0, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:11:32 user nova-compute[70374]: INFO os_vif [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:aa:06,bridge_name='br-int',has_traffic_filtering=True,id=73c76a81-a04f-4f93-9293-d1821de55355,network=Network(2b856a3a-7704-4076-840c-e16ea49f7cab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c76a81-a0')
Jul 27 10:11:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Deleting instance files /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630_del
Jul 27 10:11:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Deletion of /opt/stack/data/nova/instances/ffe6d95c-b6cd-4d0b-a276-553b0800c630_del complete
Jul 27 10:11:32 user nova-compute[70374]: INFO nova.compute.manager [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 27 10:11:32 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:11:32 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:11:33 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:11:33 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Took 0.44 seconds to deallocate network for instance.
Jul 27 10:11:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:11:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:11:33 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:11:33 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:11:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:11:33 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Deleted allocations for instance ffe6d95c-b6cd-4d0b-a276-553b0800c630
Jul 27 10:11:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-7b710c09-f22b-4c1e-ba14-802809fe5f1f tempest-ServerBootFromVolumeStableRescueTest-1815884142 tempest-ServerBootFromVolumeStableRescueTest-1815884142-project-member] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.647s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:11:34 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:34 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:11:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-e512b1fd-da06-42dd-9d80-62012aff94ba req-0dfbbe65-99c3-4670-bd87-357690f0b335 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received event network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:11:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e512b1fd-da06-42dd-9d80-62012aff94ba req-0dfbbe65-99c3-4670-bd87-357690f0b335 service nova] Acquiring lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:11:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e512b1fd-da06-42dd-9d80-62012aff94ba req-0dfbbe65-99c3-4670-bd87-357690f0b335 service nova] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:11:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-e512b1fd-da06-42dd-9d80-62012aff94ba req-0dfbbe65-99c3-4670-bd87-357690f0b335 service nova] Lock "ffe6d95c-b6cd-4d0b-a276-553b0800c630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:11:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-e512b1fd-da06-42dd-9d80-62012aff94ba req-0dfbbe65-99c3-4670-bd87-357690f0b335 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] No waiting events found dispatching network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:11:34 user nova-compute[70374]: WARNING nova.compute.manager [req-e512b1fd-da06-42dd-9d80-62012aff94ba req-0dfbbe65-99c3-4670-bd87-357690f0b335 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received unexpected event network-vif-plugged-73c76a81-a04f-4f93-9293-d1821de55355 for instance with vm_state deleted and task_state None.
Jul 27 10:11:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-e512b1fd-da06-42dd-9d80-62012aff94ba req-0dfbbe65-99c3-4670-bd87-357690f0b335 service nova] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Received event network-vif-deleted-73c76a81-a04f-4f93-9293-d1821de55355 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:11:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:11:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 10:11:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:42 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:11:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:11:47 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:11:47 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:11:47 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.2593994140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452692.832787, ffe6d95c-b6cd-4d0b-a276-553b0800c630 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:11:47 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] VM Stopped (Lifecycle Event)
Jul 27 10:11:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-ffab767b-d011-4d6a-a371-900f138ec77e None None] [instance: ffe6d95c-b6cd-4d0b-a276-553b0800c630] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:11:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance e0a45e75-b7d0-401d-8472-9eabc8de2e9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:11:48 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:11:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 10:11:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 10:11:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:11:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:11:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:11:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:11:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:11:58 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:11:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 10:12:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:12:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:12:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:12:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-f3c3010f-2364-41a3-9327-f5379713f822 req-7cae9275-c462-4d4d-a82e-f3de0650f725 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received event network-changed-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:12:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-f3c3010f-2364-41a3-9327-f5379713f822 req-7cae9275-c462-4d4d-a82e-f3de0650f725 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Refreshing instance network info cache due to event network-changed-7e12303f-2b34-4514-950b-88e9d148d499. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:12:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f3c3010f-2364-41a3-9327-f5379713f822 req-7cae9275-c462-4d4d-a82e-f3de0650f725 service nova] Acquiring lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:12:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f3c3010f-2364-41a3-9327-f5379713f822 req-7cae9275-c462-4d4d-a82e-f3de0650f725 service nova] Acquired lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:12:27 user nova-compute[70374]: DEBUG nova.network.neutron [req-f3c3010f-2364-41a3-9327-f5379713f822 req-7cae9275-c462-4d4d-a82e-f3de0650f725 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Refreshing network info cache for port 7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:12:28 user nova-compute[70374]: INFO nova.compute.manager [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Terminating instance
Jul 27 10:12:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf3f57d4-486c-4fe6-af01-6f596fc96acc req-3b04a51b-6865-406d-8bb2-c5780bbc4708 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received event network-vif-unplugged-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf3f57d4-486c-4fe6-af01-6f596fc96acc req-3b04a51b-6865-406d-8bb2-c5780bbc4708 service nova] Acquiring lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf3f57d4-486c-4fe6-af01-6f596fc96acc req-3b04a51b-6865-406d-8bb2-c5780bbc4708 service nova] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf3f57d4-486c-4fe6-af01-6f596fc96acc req-3b04a51b-6865-406d-8bb2-c5780bbc4708 service nova] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf3f57d4-486c-4fe6-af01-6f596fc96acc req-3b04a51b-6865-406d-8bb2-c5780bbc4708 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] No waiting events found dispatching network-vif-unplugged-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf3f57d4-486c-4fe6-af01-6f596fc96acc req-3b04a51b-6865-406d-8bb2-c5780bbc4708 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received event network-vif-unplugged-7e12303f-2b34-4514-950b-88e9d148d499 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-f3c3010f-2364-41a3-9327-f5379713f822 req-7cae9275-c462-4d4d-a82e-f3de0650f725 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Updated VIF entry in instance network info cache for port 7e12303f-2b34-4514-950b-88e9d148d499. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG nova.network.neutron [req-f3c3010f-2364-41a3-9327-f5379713f822 req-7cae9275-c462-4d4d-a82e-f3de0650f725 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Updating instance_info_cache with network_info: [{"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:12:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f3c3010f-2364-41a3-9327-f5379713f822 req-7cae9275-c462-4d4d-a82e-f3de0650f725 service nova] Releasing lock "refresh_cache-e0a45e75-b7d0-401d-8472-9eabc8de2e9c" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:12:29 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Instance destroyed successfully.
Jul 27 10:12:29 user nova-compute[70374]: DEBUG nova.objects.instance [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'resources' on Instance uuid e0a45e75-b7d0-401d-8472-9eabc8de2e9c {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007385300',display_name='tempest-TestVolumeBootPattern-server-1007385300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1007385300',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-6f75pxxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:10:48Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=e0a45e75-b7d0-401d-8472-9eabc8de2e9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "7e12303f-2b34-4514-950b-88e9d148d499", "address": "fa:16:3e:a2:2b:c8", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e12303f-2b", "ovs_interfaceid": "7e12303f-2b34-4514-950b-88e9d148d499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e12303f-2b34-4514-950b-88e9d148d499,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e12303f-2b') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_vif [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e12303f-2b34-4514-950b-88e9d148d499,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e12303f-2b') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e12303f-2b, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:12:29 user nova-compute[70374]: INFO os_vif [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e12303f-2b34-4514-950b-88e9d148d499,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e12303f-2b')
Jul 27 10:12:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyclJSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:12:29 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be6178-4c46-4ed9-93e1-ba6803c020d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:12:29 user nova-compute[70374]: No targets found.
Jul 27 10:12:29 user nova-compute[70374]: iSNS:
Jul 27 10:12:29 user nova-compute[70374]: No targets found.
Jul 27 10:12:29 user nova-compute[70374]: STATIC:
Jul 27 10:12:29 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506
Jul 27 10:12:29 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:12:29 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:12:29 user nova-compute[70374]: FIRMWARE:
Jul 27 10:12:29 user nova-compute[70374]: No targets found.
Jul 27 10:12:29 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:12:29 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:12:29 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8eb1f5-4aba-4ed2-9d31-4bf992366eee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5480b4c0-f840-48cc-985d-1ff184b91135]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:12:29 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:12:29 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5d7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe07476a-b929-4b73-a190-20cff4c0b47f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd057915-aa40-4248-ad8c-ac0c023a0e8b]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db25977-b70e-4402-b40a-e87ced60e8f0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[50afa158-accc-4592-b065-993b5cea61ab]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0880ff-6004-4954-b633-531075349d18]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[00988cfd-3682-4b86-8222-ae0d8c3c3e7e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260]
Jul 27 10:12:29 user nova-compute[70374]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260] successful.
Jul 27 10:12:29 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78bc659-8c38-4c33-ad61-acee7d3133e6]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== disconnect_volume: return (281ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:12:29 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Deleting instance files /opt/stack/data/nova/instances/e0a45e75-b7d0-401d-8472-9eabc8de2e9c_del
Jul 27 10:12:29 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Deletion of /opt/stack/data/nova/instances/e0a45e75-b7d0-401d-8472-9eabc8de2e9c_del complete
Jul 27 10:12:29 user nova-compute[70374]: INFO nova.compute.manager [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 27 10:12:29 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:12:29 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:12:30 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:12:30 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Took 1.05 seconds to deallocate network for instance.
Jul 27 10:12:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-3a1d9143-1246-473c-928c-78038402f743 req-16ef0407-b6e7-461b-b80b-42a95dd6c1b3 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received event network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:12:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a1d9143-1246-473c-928c-78038402f743 req-16ef0407-b6e7-461b-b80b-42a95dd6c1b3 service nova] Acquiring lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:12:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a1d9143-1246-473c-928c-78038402f743 req-16ef0407-b6e7-461b-b80b-42a95dd6c1b3 service nova] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:12:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3a1d9143-1246-473c-928c-78038402f743 req-16ef0407-b6e7-461b-b80b-42a95dd6c1b3 service nova] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:12:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-3a1d9143-1246-473c-928c-78038402f743 req-16ef0407-b6e7-461b-b80b-42a95dd6c1b3 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] No waiting events found dispatching network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:12:30 user nova-compute[70374]: WARNING nova.compute.manager [req-3a1d9143-1246-473c-928c-78038402f743 req-16ef0407-b6e7-461b-b80b-42a95dd6c1b3 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received unexpected event network-vif-plugged-7e12303f-2b34-4514-950b-88e9d148d499 for instance with vm_state active and task_state deleting.
Jul 27 10:12:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-3a1d9143-1246-473c-928c-78038402f743 req-16ef0407-b6e7-461b-b80b-42a95dd6c1b3 service nova] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Received event network-vif-deleted-7e12303f-2b34-4514-950b-88e9d148d499 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:12:31 user nova-compute[70374]: INFO nova.compute.manager [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Took 0.71 seconds to detach 1 volumes for instance.
Jul 27 10:12:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:12:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:12:31 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:12:31 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:12:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:12:31 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Deleted allocations for instance e0a45e75-b7d0-401d-8472-9eabc8de2e9c
Jul 27 10:12:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-93fa0121-6258-4237-b81d-b66725046a40 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "e0a45e75-b7d0-401d-8472-9eabc8de2e9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.295s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:12:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:12:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:40 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:12:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:12:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 10:12:42 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:44 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452749.0887444, e0a45e75-b7d0-401d-8472-9eabc8de2e9c => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:12:44 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] VM Stopped (Lifecycle Event)
Jul 27 10:12:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-710329c7-dd00-483a-b012-21bdf67a395d None None] [instance: e0a45e75-b7d0-401d-8472-9eabc8de2e9c] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:12:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:12:49 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:12:49 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:12:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=25.257652282714844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:12:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:12:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:12:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:12:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:05 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:13:20 user nova-compute[70374]: INFO nova.compute.claims [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Claim successful on node user
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.network.neutron [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:13:20 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:13:20 user nova-compute[70374]: INFO nova.virt.block_device [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Booting with volume 2852526d-fbf1-422b-bcf9-224b87411506 at /dev/vda
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.policy [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6e02625621443392a958dd87d679a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e1ff0e178842deba4c0efce3b84cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG os_brick.utils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec6d36f-a1e0-4ef5-8264-afb7883bfe8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d14af8-38d5-4afd-91b7-b202ff57b16b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeea00b-029f-44b6-85ee-b41d8be63872]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[85531d7c-bf46-4148-823d-85f0a5b6e97a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:13:20 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:13:20 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8687d51-c249-4b24-a27b-9a60a6409f4d]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG os_brick.utils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:13:20 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating existing volume attachment record: 82ce2f1f-d604-4b32-894e-d958fcb3f395 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:13:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:21 user nova-compute[70374]: DEBUG nova.network.neutron [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Successfully created port: b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Successfully updated port: b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquired lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-d6826563-8b60-4b43-8fcc-bde85e0f52ff req-66dc7753-26ad-4a33-b796-293f53049e64 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-changed-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG nova.compute.manager [req-d6826563-8b60-4b43-8fcc-bde85e0f52ff req-66dc7753-26ad-4a33-b796-293f53049e64 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Refreshing instance network info cache due to event network-changed-b394486c-5c3f-4ec1-966f-261cf4a75107. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d6826563-8b60-4b43-8fcc-bde85e0f52ff req-66dc7753-26ad-4a33-b796-293f53049e64 service nova] Acquiring lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG nova.network.neutron [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating instance_info_cache with network_info: [{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Releasing lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Instance network_info: |[{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d6826563-8b60-4b43-8fcc-bde85e0f52ff req-66dc7753-26ad-4a33-b796-293f53049e64 service nova] Acquired lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:13:22 user nova-compute[70374]: DEBUG nova.network.neutron [req-d6826563-8b60-4b43-8fcc-bde85e0f52ff req-66dc7753-26ad-4a33-b796-293f53049e64 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Refreshing network info cache for port b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:13:23 user nova-compute[70374]: DEBUG nova.network.neutron [req-d6826563-8b60-4b43-8fcc-bde85e0f52ff req-66dc7753-26ad-4a33-b796-293f53049e64 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updated VIF entry in instance network info cache for port b394486c-5c3f-4ec1-966f-261cf4a75107. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:13:23 user nova-compute[70374]: DEBUG nova.network.neutron [req-d6826563-8b60-4b43-8fcc-bde85e0f52ff req-66dc7753-26ad-4a33-b796-293f53049e64 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating instance_info_cache with network_info: [{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:13:23 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d6826563-8b60-4b43-8fcc-bde85e0f52ff req-66dc7753-26ad-4a33-b796-293f53049e64 service nova] Releasing lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:13:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:13:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Creating image(s)
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Ensure instance console log exists: /opt/stack/data/nova/instances/25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Start _get_guest_xml network_info=[{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '82ce2f1f-d604-4b32-894e-d958fcb3f395', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyclJSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6', 'attached_at': '', 'detached_at': '', 'volume_id': '2852526d-fbf1-422b-bcf9-224b87411506', 'serial': '2852526d-fbf1-422b-bcf9-224b87411506'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:13:27 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:13:27 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyclJSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:13:27 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:13:27 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:13:27 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df3a5c7-a47e-40ee-8768-abb161a52f4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:13:27 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e939100-b2dc-4776-9b0d-121e119d2c02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506] added
Jul 27 10:13:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64f0092-4b26-4b38-b191-b7544686f87c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9205145-bdb4-4a2d-b018-7431cfb2bcee]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUyclJSM {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUyclJSM" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6f3851-6699-4d2b-b4f3-ab42f329c3c5]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUyclJSM'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dfaf19-b808-40b3-ad4e-b6493c65ef1e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70766dc-ee08-4cf7-bade-41514c59086b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:13:27 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:13:27 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:13:27 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 10:13:27 user nova-compute[70374]: 
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8949142-810c-4366-8eb7-ea43d39a5865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260]
Jul 27 10:13:27 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260] successful.
Jul 27 10:13:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaaf00f-877f-439f-a4d1-d62cd13c6c9a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[617663fc-3214-41c1-a9f4-5575fe3acaa2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:13:28 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:13:28 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0546d3-8ba2-438f-8da1-b6a99dee5ee2]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:28 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyclJSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26533633935343636', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633935343636', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2004930609',display_name='tempest-TestVolumeBootPattern-server-2004930609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2004930609',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-wuv187wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:13:21Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:3c,bridge_name='br-int',has_traffic_filtering=True,id=b394486c-5c3f-4ec1-966f-261cf4a75107,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb394486c-5c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.objects.instance [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'pci_devices' on Instance uuid 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:13:29 user nova-compute[70374]:   <uuid>25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6</uuid>
Jul 27 10:13:29 user nova-compute[70374]:   <name>instance-00000030</name>
Jul 27 10:13:29 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:13:29 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:13:29 user nova-compute[70374]:   <metadata>
Jul 27 10:13:29 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:13:29 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:13:29 user nova-compute[70374]:       <nova:name>tempest-TestVolumeBootPattern-server-2004930609</nova:name>
Jul 27 10:13:29 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:13:27</nova:creationTime>
Jul 27 10:13:29 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:13:29 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:13:29 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:13:29 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:13:29 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:13:29 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:13:29 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:13:29 user nova-compute[70374]:       <nova:owner>
Jul 27 10:13:29 user nova-compute[70374]:         <nova:user uuid="fc6e02625621443392a958dd87d679a3">tempest-TestVolumeBootPattern-953954878-project-member</nova:user>
Jul 27 10:13:29 user nova-compute[70374]:         <nova:project uuid="52e1ff0e178842deba4c0efce3b84cf8">tempest-TestVolumeBootPattern-953954878</nova:project>
Jul 27 10:13:29 user nova-compute[70374]:       </nova:owner>
Jul 27 10:13:29 user nova-compute[70374]:       <nova:ports>
Jul 27 10:13:29 user nova-compute[70374]:         <nova:port uuid="b394486c-5c3f-4ec1-966f-261cf4a75107">
Jul 27 10:13:29 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 10:13:29 user nova-compute[70374]:         </nova:port>
Jul 27 10:13:29 user nova-compute[70374]:       </nova:ports>
Jul 27 10:13:29 user nova-compute[70374]:     </nova:instance>
Jul 27 10:13:29 user nova-compute[70374]:   </metadata>
Jul 27 10:13:29 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:13:29 user nova-compute[70374]:     <system>
Jul 27 10:13:29 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:13:29 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:13:29 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:13:29 user nova-compute[70374]:       <entry name="serial">25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6</entry>
Jul 27 10:13:29 user nova-compute[70374]:       <entry name="uuid">25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6</entry>
Jul 27 10:13:29 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:13:29 user nova-compute[70374]:     </system>
Jul 27 10:13:29 user nova-compute[70374]:   </sysinfo>
Jul 27 10:13:29 user nova-compute[70374]:   <os>
Jul 27 10:13:29 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:13:29 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:13:29 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:13:29 user nova-compute[70374]:   </os>
Jul 27 10:13:29 user nova-compute[70374]:   <features>
Jul 27 10:13:29 user nova-compute[70374]:     <acpi/>
Jul 27 10:13:29 user nova-compute[70374]:     <apic/>
Jul 27 10:13:29 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:13:29 user nova-compute[70374]:   </features>
Jul 27 10:13:29 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:13:29 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:13:29 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:13:29 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:13:29 user nova-compute[70374]:   </clock>
Jul 27 10:13:29 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:13:29 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:13:29 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:13:29 user nova-compute[70374]:   </cpu>
Jul 27 10:13:29 user nova-compute[70374]:   <devices>
Jul 27 10:13:29 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:13:29 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:13:29 user nova-compute[70374]:       <source dev="/dev/sdb"/>
Jul 27 10:13:29 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:13:29 user nova-compute[70374]:       <serial>2852526d-fbf1-422b-bcf9-224b87411506</serial>
Jul 27 10:13:29 user nova-compute[70374]:     </disk>
Jul 27 10:13:29 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:13:29 user nova-compute[70374]:       <mac address="fa:16:3e:41:15:3c"/>
Jul 27 10:13:29 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:13:29 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:13:29 user nova-compute[70374]:       <target dev="tapb394486c-5c"/>
Jul 27 10:13:29 user nova-compute[70374]:     </interface>
Jul 27 10:13:29 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:13:29 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6/console.log" append="off"/>
Jul 27 10:13:29 user nova-compute[70374]:     </serial>
Jul 27 10:13:29 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:13:29 user nova-compute[70374]:     <video>
Jul 27 10:13:29 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:13:29 user nova-compute[70374]:     </video>
Jul 27 10:13:29 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:13:29 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:13:29 user nova-compute[70374]:     </rng>
Jul 27 10:13:29 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:13:29 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:13:29 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:13:29 user nova-compute[70374]:     </memballoon>
Jul 27 10:13:29 user nova-compute[70374]:   </devices>
Jul 27 10:13:29 user nova-compute[70374]: </domain>
Jul 27 10:13:29 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2004930609',display_name='tempest-TestVolumeBootPattern-server-2004930609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2004930609',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-wuv187wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:13:21Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:3c,bridge_name='br-int',has_traffic_filtering=True,id=b394486c-5c3f-4ec1-966f-261cf4a75107,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb394486c-5c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG os_vif [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:3c,bridge_name='br-int',has_traffic_filtering=True,id=b394486c-5c3f-4ec1-966f-261cf4a75107,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb394486c-5c') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb394486c-5c, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb394486c-5c, col_values=(('external_ids', {'iface-id': 'b394486c-5c3f-4ec1-966f-261cf4a75107', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:15:3c', 'vm-uuid': '25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:29 user nova-compute[70374]: INFO os_vif [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:3c,bridge_name='br-int',has_traffic_filtering=True,id=b394486c-5c3f-4ec1-966f-261cf4a75107,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb394486c-5c')
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:13:29 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No VIF found with MAC fa:16:3e:41:15:3c, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:13:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-90141816-edfd-402e-a085-5cb5ca8ebb23 req-61f52133-6776-45e8-8100-33c9e001a623 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:13:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-90141816-edfd-402e-a085-5cb5ca8ebb23 req-61f52133-6776-45e8-8100-33c9e001a623 service nova] Acquiring lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-90141816-edfd-402e-a085-5cb5ca8ebb23 req-61f52133-6776-45e8-8100-33c9e001a623 service nova] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-90141816-edfd-402e-a085-5cb5ca8ebb23 req-61f52133-6776-45e8-8100-33c9e001a623 service nova] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:30 user nova-compute[70374]: DEBUG nova.compute.manager [req-90141816-edfd-402e-a085-5cb5ca8ebb23 req-61f52133-6776-45e8-8100-33c9e001a623 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] No waiting events found dispatching network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:13:30 user nova-compute[70374]: WARNING nova.compute.manager [req-90141816-edfd-402e-a085-5cb5ca8ebb23 req-61f52133-6776-45e8-8100-33c9e001a623 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received unexpected event network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 for instance with vm_state building and task_state spawning.
Jul 27 10:13:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452812.4971986, 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:13:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] VM Resumed (Lifecycle Event)
Jul 27 10:13:32 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Instance spawned successfully.
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:13:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452812.498195, 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:13:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] VM Started (Lifecycle Event)
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:13:32 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:13:32 user nova-compute[70374]: INFO nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Took 4.94 seconds to spawn the instance on the hypervisor.
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:13:32 user nova-compute[70374]: INFO nova.compute.manager [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Took 12.34 seconds to build instance.
Jul 27 10:13:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-9bb8cd55-4894-4a38-9eb2-70e0e6491cbd tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.435s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-71fe5cdf-5e4c-40a8-9377-fbf33fd13eb0 req-d2099f89-16e6-475d-b03f-b1729462d2ea service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71fe5cdf-5e4c-40a8-9377-fbf33fd13eb0 req-d2099f89-16e6-475d-b03f-b1729462d2ea service nova] Acquiring lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71fe5cdf-5e4c-40a8-9377-fbf33fd13eb0 req-d2099f89-16e6-475d-b03f-b1729462d2ea service nova] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-71fe5cdf-5e4c-40a8-9377-fbf33fd13eb0 req-d2099f89-16e6-475d-b03f-b1729462d2ea service nova] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:32 user nova-compute[70374]: DEBUG nova.compute.manager [req-71fe5cdf-5e4c-40a8-9377-fbf33fd13eb0 req-d2099f89-16e6-475d-b03f-b1729462d2ea service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] No waiting events found dispatching network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:13:32 user nova-compute[70374]: WARNING nova.compute.manager [req-71fe5cdf-5e4c-40a8-9377-fbf33fd13eb0 req-d2099f89-16e6-475d-b03f-b1729462d2ea service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received unexpected event network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 for instance with vm_state active and task_state None.
Jul 27 10:13:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:13:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:40 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:13:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:13:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:13:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:13:40 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:13:40 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:13:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:41 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating instance_info_cache with network_info: [{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:13:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:13:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:13:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:44 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:44 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:49 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:13:49 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:13:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=25.25389862060547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 513b0d57-db1f-4d0e-805e-013c6331ebcd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1735}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.118s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:13:50 user nova-compute[70374]: INFO nova.compute.claims [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Claim successful on node user
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:13:50 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:13:50 user nova-compute[70374]: INFO nova.virt.block_device [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Booting with volume 72fbbc0b-d857-4b51-817c-2895eeedb4a3 at /dev/vda
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.policy [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e79bd5dd4f75439194c8f653b0b324b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f18ab7fd5474bae9826302b087d6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG os_brick.utils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[78732bb1-9077-43f2-9e2d-e1a5bcf660ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f72ac-2169-4531-ac1a-7a526ff3f34f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d6b47-fc03-4362-a442-4c5b0c04f84d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fdb305-0038-41c9-a008-f99b37c8d0a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:13:50 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:13:50 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[927bae90-5257-4832-b345-075900dc79ee]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG os_brick.utils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating existing volume attachment record: a90dc88d-2da8-490d-82d4-99a7b7c98cf1 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:13:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:51 user nova-compute[70374]: DEBUG nova.network.neutron [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Successfully created port: 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Successfully updated port: 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-7bd82686-97e5-4ba3-a0ba-51516c62d714 req-f8c768b3-c913-45c0-b687-ef1100f8da59 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.compute.manager [req-7bd82686-97e5-4ba3-a0ba-51516c62d714 req-f8c768b3-c913-45c0-b687-ef1100f8da59 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing instance network info cache due to event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7bd82686-97e5-4ba3-a0ba-51516c62d714 req-f8c768b3-c913-45c0-b687-ef1100f8da59 service nova] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.network.neutron [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance network_info: |[{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7bd82686-97e5-4ba3-a0ba-51516c62d714 req-f8c768b3-c913-45c0-b687-ef1100f8da59 service nova] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-7bd82686-97e5-4ba3-a0ba-51516c62d714 req-f8c768b3-c913-45c0-b687-ef1100f8da59 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-7bd82686-97e5-4ba3-a0ba-51516c62d714 req-f8c768b3-c913-45c0-b687-ef1100f8da59 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updated VIF entry in instance network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG nova.network.neutron [req-7bd82686-97e5-4ba3-a0ba-51516c62d714 req-f8c768b3-c913-45c0-b687-ef1100f8da59 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:13:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-7bd82686-97e5-4ba3-a0ba-51516c62d714 req-f8c768b3-c913-45c0-b687-ef1100f8da59 service nova] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:13:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:13:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Creating image(s)
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Ensure instance console log exists: /opt/stack/data/nova/instances/513b0d57-db1f-4d0e-805e-013c6331ebcd/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Start _get_guest_xml network_info=[{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': 'a90dc88d-2da8-490d-82d4-99a7b7c98cf1', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvXzTCIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '513b0d57-db1f-4d0e-805e-013c6331ebcd', 'attached_at': '', 'detached_at': '', 'volume_id': '72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'serial': '72fbbc0b-d857-4b51-817c-2895eeedb4a3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:13:57 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:13:57 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvXzTCIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:13:57 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:13:57 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:13:57 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7508368-7fdd-473d-829a-036289ba40d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:13:57 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[250d2ae8-a130-4218-877c-b023f6f21d76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3] added
Jul 27 10:13:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8d1329-5a37-43da-b64b-221d43d9b154]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ff027b-a17d-4681-9287-4dcd4f17635f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvXzTCIj {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvXzTCIj" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b80d56-6ea6-4438-baca-c5151ff9125d]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VvXzTCIj'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92c1c4b-b503-4cb2-9a6d-781daf1d2447]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e8207-94d6-4139-a845-d979e857b361]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:13:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:13:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1544005f-603d-4470-8cdc-8bffb5f0af9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260]
Jul 27 10:13:57 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260] successful.
Jul 27 10:13:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f58aa-3ed0-477a-ae9f-050b02f99619]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c698d9e7-00f4-4ce0-9bab-6664fe4597d0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:13:57 user nova-compute[70374]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:13:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:13:57 user nova-compute[70374]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:13:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffbfeb1-1fef-43de-8f29-7cfa936d2024]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:13:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvXzTCIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23732616162633438', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732616162633438', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1242647726',display_name='tempest-TestShelveInstance-server-1242647726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1242647726',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwYnLwtSeXA4dbtUMnzj2pbLq3APrmZhFkUd2cKju6Iub+rQ76xbtRzBwY0lzlgKd4kL22hu/gQ+Tw85SVQvI2js0zhmhX7sYTGvrXcvSl6fAb/5mO+NtL3nsi1XhJWCA==',key_name='tempest-TestShelveInstance-372801412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f18ab7fd5474bae9826302b087d6135',ramdisk_id='',reservation_id='r-dna1hw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1997463019',owner_user_name='tempest-TestShelveInstance-1997463019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:13:51Z,user_data=None,user_id='e79bd5dd4f75439194c8f653b0b324b7',uuid=513b0d57-db1f-4d0e-805e-013c6331ebcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converting VIF {"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.objects.instance [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lazy-loading 'pci_devices' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:13:58 user nova-compute[70374]:   <uuid>513b0d57-db1f-4d0e-805e-013c6331ebcd</uuid>
Jul 27 10:13:58 user nova-compute[70374]:   <name>instance-00000031</name>
Jul 27 10:13:58 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:13:58 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:13:58 user nova-compute[70374]:   <metadata>
Jul 27 10:13:58 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:13:58 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:13:58 user nova-compute[70374]:       <nova:name>tempest-TestShelveInstance-server-1242647726</nova:name>
Jul 27 10:13:58 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:13:57</nova:creationTime>
Jul 27 10:13:58 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:13:58 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:13:58 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:13:58 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:13:58 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:13:58 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:13:58 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:13:58 user nova-compute[70374]:       <nova:owner>
Jul 27 10:13:58 user nova-compute[70374]:         <nova:user uuid="e79bd5dd4f75439194c8f653b0b324b7">tempest-TestShelveInstance-1997463019-project-member</nova:user>
Jul 27 10:13:58 user nova-compute[70374]:         <nova:project uuid="7f18ab7fd5474bae9826302b087d6135">tempest-TestShelveInstance-1997463019</nova:project>
Jul 27 10:13:58 user nova-compute[70374]:       </nova:owner>
Jul 27 10:13:58 user nova-compute[70374]:       <nova:ports>
Jul 27 10:13:58 user nova-compute[70374]:         <nova:port uuid="67f43f65-0c9d-41a0-ac07-bdd7ebd91f39">
Jul 27 10:13:58 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 10:13:58 user nova-compute[70374]:         </nova:port>
Jul 27 10:13:58 user nova-compute[70374]:       </nova:ports>
Jul 27 10:13:58 user nova-compute[70374]:     </nova:instance>
Jul 27 10:13:58 user nova-compute[70374]:   </metadata>
Jul 27 10:13:58 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:13:58 user nova-compute[70374]:     <system>
Jul 27 10:13:58 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:13:58 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:13:58 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:13:58 user nova-compute[70374]:       <entry name="serial">513b0d57-db1f-4d0e-805e-013c6331ebcd</entry>
Jul 27 10:13:58 user nova-compute[70374]:       <entry name="uuid">513b0d57-db1f-4d0e-805e-013c6331ebcd</entry>
Jul 27 10:13:58 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:13:58 user nova-compute[70374]:     </system>
Jul 27 10:13:58 user nova-compute[70374]:   </sysinfo>
Jul 27 10:13:58 user nova-compute[70374]:   <os>
Jul 27 10:13:58 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:13:58 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:13:58 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:13:58 user nova-compute[70374]:   </os>
Jul 27 10:13:58 user nova-compute[70374]:   <features>
Jul 27 10:13:58 user nova-compute[70374]:     <acpi/>
Jul 27 10:13:58 user nova-compute[70374]:     <apic/>
Jul 27 10:13:58 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:13:58 user nova-compute[70374]:   </features>
Jul 27 10:13:58 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:13:58 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:13:58 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:13:58 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:13:58 user nova-compute[70374]:   </clock>
Jul 27 10:13:58 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:13:58 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:13:58 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:13:58 user nova-compute[70374]:   </cpu>
Jul 27 10:13:58 user nova-compute[70374]:   <devices>
Jul 27 10:13:58 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:13:58 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:13:58 user nova-compute[70374]:       <source dev="/dev/sdc"/>
Jul 27 10:13:58 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:13:58 user nova-compute[70374]:       <serial>72fbbc0b-d857-4b51-817c-2895eeedb4a3</serial>
Jul 27 10:13:58 user nova-compute[70374]:     </disk>
Jul 27 10:13:58 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:13:58 user nova-compute[70374]:       <mac address="fa:16:3e:a4:2f:c7"/>
Jul 27 10:13:58 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:13:58 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:13:58 user nova-compute[70374]:       <target dev="tap67f43f65-0c"/>
Jul 27 10:13:58 user nova-compute[70374]:     </interface>
Jul 27 10:13:58 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:13:58 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/513b0d57-db1f-4d0e-805e-013c6331ebcd/console.log" append="off"/>
Jul 27 10:13:58 user nova-compute[70374]:     </serial>
Jul 27 10:13:58 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:13:58 user nova-compute[70374]:     <video>
Jul 27 10:13:58 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:13:58 user nova-compute[70374]:     </video>
Jul 27 10:13:58 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:13:58 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:13:58 user nova-compute[70374]:     </rng>
Jul 27 10:13:58 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:13:58 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:13:58 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:13:58 user nova-compute[70374]:     </memballoon>
Jul 27 10:13:58 user nova-compute[70374]:   </devices>
Jul 27 10:13:58 user nova-compute[70374]: </domain>
Jul 27 10:13:58 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1242647726',display_name='tempest-TestShelveInstance-server-1242647726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1242647726',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwYnLwtSeXA4dbtUMnzj2pbLq3APrmZhFkUd2cKju6Iub+rQ76xbtRzBwY0lzlgKd4kL22hu/gQ+Tw85SVQvI2js0zhmhX7sYTGvrXcvSl6fAb/5mO+NtL3nsi1XhJWCA==',key_name='tempest-TestShelveInstance-372801412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f18ab7fd5474bae9826302b087d6135',ramdisk_id='',reservation_id='r-dna1hw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1997463019',owner_user_name='tempest-TestShelveInstance-1997463019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:13:51Z,user_data=None,user_id='e79bd5dd4f75439194c8f653b0b324b7',uuid=513b0d57-db1f-4d0e-805e-013c6331ebcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converting VIF {"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG os_vif [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67f43f65-0c, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67f43f65-0c, col_values=(('external_ids', {'iface-id': '67f43f65-0c9d-41a0-ac07-bdd7ebd91f39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:2f:c7', 'vm-uuid': '513b0d57-db1f-4d0e-805e-013c6331ebcd'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:58 user nova-compute[70374]: INFO os_vif [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c')
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:13:58 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] No VIF found with MAC fa:16:3e:a4:2f:c7, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:13:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:13:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-ac12a52b-092d-4cb1-96a4-2a0e576351ca req-1f4890a8-6c31-4cb9-b357-3a4d9465bbd4 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:13:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ac12a52b-092d-4cb1-96a4-2a0e576351ca req-1f4890a8-6c31-4cb9-b357-3a4d9465bbd4 service nova] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:13:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ac12a52b-092d-4cb1-96a4-2a0e576351ca req-1f4890a8-6c31-4cb9-b357-3a4d9465bbd4 service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:13:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ac12a52b-092d-4cb1-96a4-2a0e576351ca req-1f4890a8-6c31-4cb9-b357-3a4d9465bbd4 service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:13:59 user nova-compute[70374]: DEBUG nova.compute.manager [req-ac12a52b-092d-4cb1-96a4-2a0e576351ca req-1f4890a8-6c31-4cb9-b357-3a4d9465bbd4 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] No waiting events found dispatching network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:13:59 user nova-compute[70374]: WARNING nova.compute.manager [req-ac12a52b-092d-4cb1-96a4-2a0e576351ca req-1f4890a8-6c31-4cb9-b357-3a4d9465bbd4 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received unexpected event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 for instance with vm_state building and task_state spawning.
Jul 27 10:14:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452841.831549, 513b0d57-db1f-4d0e-805e-013c6331ebcd => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:14:01 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] VM Resumed (Lifecycle Event)
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:14:01 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance spawned successfully.
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:14:01 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452841.8334494, 513b0d57-db1f-4d0e-805e-013c6331ebcd => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:14:01 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] VM Started (Lifecycle Event)
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:14:01 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:14:01 user nova-compute[70374]: INFO nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Took 4.86 seconds to spawn the instance on the hypervisor.
Jul 27 10:14:01 user nova-compute[70374]: DEBUG nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:14:02 user nova-compute[70374]: INFO nova.compute.manager [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Took 11.99 seconds to build instance.
Jul 27 10:14:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-d89d923d-fb25-439d-a924-559502e982d1 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.086s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:14:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-8e1069b9-89ea-4a07-a04c-5c918bd99bb8 req-91d582d9-729f-49c7-bd7d-9295d19410c6 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:14:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8e1069b9-89ea-4a07-a04c-5c918bd99bb8 req-91d582d9-729f-49c7-bd7d-9295d19410c6 service nova] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:14:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8e1069b9-89ea-4a07-a04c-5c918bd99bb8 req-91d582d9-729f-49c7-bd7d-9295d19410c6 service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:14:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-8e1069b9-89ea-4a07-a04c-5c918bd99bb8 req-91d582d9-729f-49c7-bd7d-9295d19410c6 service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:14:02 user nova-compute[70374]: DEBUG nova.compute.manager [req-8e1069b9-89ea-4a07-a04c-5c918bd99bb8 req-91d582d9-729f-49c7-bd7d-9295d19410c6 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] No waiting events found dispatching network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:14:02 user nova-compute[70374]: WARNING nova.compute.manager [req-8e1069b9-89ea-4a07-a04c-5c918bd99bb8 req-91d582d9-729f-49c7-bd7d-9295d19410c6 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received unexpected event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 for instance with vm_state active and task_state None.
Jul 27 10:14:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:33 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:38 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:38 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:14:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:14:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:14:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:14:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:14:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating instance_info_cache with network_info: [{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:14:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:14:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:14:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:14:49 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:14:49 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:14:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=25.244300842285156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 513b0d57-db1f-4d0e-805e-013c6331ebcd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:14:49 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:14:50 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:14:50 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:14:50 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:14:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:14:53 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:53 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:14:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:14:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:14:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:14:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:14:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:14:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:15:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:15:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:15:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:15:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:15:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:15:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:08 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:15:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:15:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:15:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:15:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-feb702aa-838d-4623-bd59-d6bbfe5e5704 req-2e75b542-24eb-4269-9324-0c5a1944bc9b service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-changed-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:15:12 user nova-compute[70374]: DEBUG nova.compute.manager [req-feb702aa-838d-4623-bd59-d6bbfe5e5704 req-2e75b542-24eb-4269-9324-0c5a1944bc9b service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Refreshing instance network info cache due to event network-changed-b394486c-5c3f-4ec1-966f-261cf4a75107. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:15:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-feb702aa-838d-4623-bd59-d6bbfe5e5704 req-2e75b542-24eb-4269-9324-0c5a1944bc9b service nova] Acquiring lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:15:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-feb702aa-838d-4623-bd59-d6bbfe5e5704 req-2e75b542-24eb-4269-9324-0c5a1944bc9b service nova] Acquired lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:15:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-feb702aa-838d-4623-bd59-d6bbfe5e5704 req-2e75b542-24eb-4269-9324-0c5a1944bc9b service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Refreshing network info cache for port b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:15:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-feb702aa-838d-4623-bd59-d6bbfe5e5704 req-2e75b542-24eb-4269-9324-0c5a1944bc9b service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updated VIF entry in instance network info cache for port b394486c-5c3f-4ec1-966f-261cf4a75107. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:15:12 user nova-compute[70374]: DEBUG nova.network.neutron [req-feb702aa-838d-4623-bd59-d6bbfe5e5704 req-2e75b542-24eb-4269-9324-0c5a1944bc9b service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating instance_info_cache with network_info: [{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:15:12 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-feb702aa-838d-4623-bd59-d6bbfe5e5704 req-2e75b542-24eb-4269-9324-0c5a1944bc9b service nova] Releasing lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:15:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:15:24 user nova-compute[70374]: INFO nova.compute.claims [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Claim successful on node user
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.network.neutron [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:15:24 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:15:24 user nova-compute[70374]: INFO nova.virt.block_device [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Booting with volume 09327b25-7c6b-41e6-9046-5c32b818ac9c at /dev/vda
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.policy [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6e02625621443392a958dd87d679a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e1ff0e178842deba4c0efce3b84cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG os_brick.utils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51df12dd-4588-4c4d-83e9-aab588755c15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca70d9a7-6faf-4c25-b85f-35e05e2a46ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c88a35-df01-4a33-bcc0-f104386afd6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e843c344-de72-4a20-9e98-0803c9bc8cf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:15:24 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:15:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb282c8-9598-4864-a592-5afb5c7df4cf]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG os_brick.utils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:15:24 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updating existing volume attachment record: 1e8161d7-474d-4256-8284-74ea2cc7a003 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:15:25 user nova-compute[70374]: DEBUG nova.network.neutron [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Successfully created port: 1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Successfully updated port: 1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquired lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-2a0ca4fb-8eff-438f-b053-3edd0446fceb req-29454b82-5d11-4556-a0e1-83c9ef128987 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-changed-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-2a0ca4fb-8eff-438f-b053-3edd0446fceb req-29454b82-5d11-4556-a0e1-83c9ef128987 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Refreshing instance network info cache due to event network-changed-1de9bd20-d200-4afe-8d90-9897f7bb11df. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2a0ca4fb-8eff-438f-b053-3edd0446fceb req-29454b82-5d11-4556-a0e1-83c9ef128987 service nova] Acquiring lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.network.neutron [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updating instance_info_cache with network_info: [{"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Releasing lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Instance network_info: |[{"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2a0ca4fb-8eff-438f-b053-3edd0446fceb req-29454b82-5d11-4556-a0e1-83c9ef128987 service nova] Acquired lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-2a0ca4fb-8eff-438f-b053-3edd0446fceb req-29454b82-5d11-4556-a0e1-83c9ef128987 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Refreshing network info cache for port 1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-2a0ca4fb-8eff-438f-b053-3edd0446fceb req-29454b82-5d11-4556-a0e1-83c9ef128987 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updated VIF entry in instance network info cache for port 1de9bd20-d200-4afe-8d90-9897f7bb11df. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-2a0ca4fb-8eff-438f-b053-3edd0446fceb req-29454b82-5d11-4556-a0e1-83c9ef128987 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updating instance_info_cache with network_info: [{"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:15:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2a0ca4fb-8eff-438f-b053-3edd0446fceb req-29454b82-5d11-4556-a0e1-83c9ef128987 service nova] Releasing lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:15:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:15:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:15:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:15:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:15:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:15:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Creating image(s)
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Ensure instance console log exists: /opt/stack/data/nova/instances/5e9b37ae-ec75-4617-bc58-acb1a4b8b265/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Start _get_guest_xml network_info=[{"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '1e8161d7-474d-4256-8284-74ea2cc7a003', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoTAmDGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e9b37ae-ec75-4617-bc58-acb1a4b8b265', 'attached_at': '', 'detached_at': '', 'volume_id': '09327b25-7c6b-41e6-9046-5c32b818ac9c', 'serial': '09327b25-7c6b-41e6-9046-5c32b818ac9c'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:15:35 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:15:35 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoTAmDGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:15:35 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:15:35 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:15:35 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13b4c60-03c1-44a5-8234-76ec53621200]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:15:35 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[346401e5-de5a-4c35-bdef-e4bdecc2fa12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c] added
Jul 27 10:15:35 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e767f9e-50de-4f9c-96f7-cf638bccc927]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1af0c-9387-4a72-86c7-99729f4f1590]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoTAmDGb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoTAmDGb" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8860ab-4923-4752-b271-c963ae322c96]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BoTAmDGb'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[594b97ad-be83-48a9-aa5f-c8f4964912aa]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd38cd2b-f069-4e56-9728-ba0fab5a1849]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:15:35 user nova-compute[70374]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:15:35 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:15:35 user nova-compute[70374]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:15:35 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0154022-48c9-41b2-ad0f-8c287022b96d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c, portal: 172.16.0.220,3260]
Jul 27 10:15:35 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c, portal: 172.16.0.220,3260] successful.
Jul 27 10:15:35 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98be12b-458c-475d-bd9e-af3a7de5dc84]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e517566-da23-446e-b215-544706811a4c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:15:35 user nova-compute[70374]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:15:35 user nova-compute[70374]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)
Jul 27 10:15:35 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:15:35 user nova-compute[70374]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:15:35 user nova-compute[70374]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)
Jul 27 10:15:35 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaed69f-3fb5-4d0c-9f2c-5d4985833547]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:15:35 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoTAmDGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26238643834386664', 'path': '/dev/sdd'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238643834386664', 'path': '/dev/sdd'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-390712598',display_name='tempest-TestVolumeBootPattern-server-390712598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-390712598',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-t5tum745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:15:25Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=5e9b37ae-ec75-4617-bc58-acb1a4b8b265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:95:2b,bridge_name='br-int',has_traffic_filtering=True,id=1de9bd20-d200-4afe-8d90-9897f7bb11df,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9bd20-d2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.objects.instance [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e9b37ae-ec75-4617-bc58-acb1a4b8b265 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:15:36 user nova-compute[70374]:   <uuid>5e9b37ae-ec75-4617-bc58-acb1a4b8b265</uuid>
Jul 27 10:15:36 user nova-compute[70374]:   <name>instance-00000032</name>
Jul 27 10:15:36 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:15:36 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:15:36 user nova-compute[70374]:   <metadata>
Jul 27 10:15:36 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:15:36 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:15:36 user nova-compute[70374]:       <nova:name>tempest-TestVolumeBootPattern-server-390712598</nova:name>
Jul 27 10:15:36 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:15:35</nova:creationTime>
Jul 27 10:15:36 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:15:36 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:15:36 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:15:36 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:15:36 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:15:36 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:15:36 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:15:36 user nova-compute[70374]:       <nova:owner>
Jul 27 10:15:36 user nova-compute[70374]:         <nova:user uuid="fc6e02625621443392a958dd87d679a3">tempest-TestVolumeBootPattern-953954878-project-member</nova:user>
Jul 27 10:15:36 user nova-compute[70374]:         <nova:project uuid="52e1ff0e178842deba4c0efce3b84cf8">tempest-TestVolumeBootPattern-953954878</nova:project>
Jul 27 10:15:36 user nova-compute[70374]:       </nova:owner>
Jul 27 10:15:36 user nova-compute[70374]:       <nova:ports>
Jul 27 10:15:36 user nova-compute[70374]:         <nova:port uuid="1de9bd20-d200-4afe-8d90-9897f7bb11df">
Jul 27 10:15:36 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 10:15:36 user nova-compute[70374]:         </nova:port>
Jul 27 10:15:36 user nova-compute[70374]:       </nova:ports>
Jul 27 10:15:36 user nova-compute[70374]:     </nova:instance>
Jul 27 10:15:36 user nova-compute[70374]:   </metadata>
Jul 27 10:15:36 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:15:36 user nova-compute[70374]:     <system>
Jul 27 10:15:36 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:15:36 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:15:36 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:15:36 user nova-compute[70374]:       <entry name="serial">5e9b37ae-ec75-4617-bc58-acb1a4b8b265</entry>
Jul 27 10:15:36 user nova-compute[70374]:       <entry name="uuid">5e9b37ae-ec75-4617-bc58-acb1a4b8b265</entry>
Jul 27 10:15:36 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:15:36 user nova-compute[70374]:     </system>
Jul 27 10:15:36 user nova-compute[70374]:   </sysinfo>
Jul 27 10:15:36 user nova-compute[70374]:   <os>
Jul 27 10:15:36 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:15:36 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:15:36 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:15:36 user nova-compute[70374]:   </os>
Jul 27 10:15:36 user nova-compute[70374]:   <features>
Jul 27 10:15:36 user nova-compute[70374]:     <acpi/>
Jul 27 10:15:36 user nova-compute[70374]:     <apic/>
Jul 27 10:15:36 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:15:36 user nova-compute[70374]:   </features>
Jul 27 10:15:36 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:15:36 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:15:36 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:15:36 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:15:36 user nova-compute[70374]:   </clock>
Jul 27 10:15:36 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:15:36 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:15:36 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:15:36 user nova-compute[70374]:   </cpu>
Jul 27 10:15:36 user nova-compute[70374]:   <devices>
Jul 27 10:15:36 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:15:36 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:15:36 user nova-compute[70374]:       <source dev="/dev/sdd"/>
Jul 27 10:15:36 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:15:36 user nova-compute[70374]:       <serial>09327b25-7c6b-41e6-9046-5c32b818ac9c</serial>
Jul 27 10:15:36 user nova-compute[70374]:     </disk>
Jul 27 10:15:36 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:15:36 user nova-compute[70374]:       <mac address="fa:16:3e:7b:95:2b"/>
Jul 27 10:15:36 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:15:36 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:15:36 user nova-compute[70374]:       <target dev="tap1de9bd20-d2"/>
Jul 27 10:15:36 user nova-compute[70374]:     </interface>
Jul 27 10:15:36 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:15:36 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/5e9b37ae-ec75-4617-bc58-acb1a4b8b265/console.log" append="off"/>
Jul 27 10:15:36 user nova-compute[70374]:     </serial>
Jul 27 10:15:36 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:15:36 user nova-compute[70374]:     <video>
Jul 27 10:15:36 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:15:36 user nova-compute[70374]:     </video>
Jul 27 10:15:36 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:15:36 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:15:36 user nova-compute[70374]:     </rng>
Jul 27 10:15:36 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:15:36 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:15:36 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:15:36 user nova-compute[70374]:     </memballoon>
Jul 27 10:15:36 user nova-compute[70374]:   </devices>
Jul 27 10:15:36 user nova-compute[70374]: </domain>
Jul 27 10:15:36 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-390712598',display_name='tempest-TestVolumeBootPattern-server-390712598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-390712598',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-t5tum745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:15:25Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=5e9b37ae-ec75-4617-bc58-acb1a4b8b265,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:95:2b,bridge_name='br-int',has_traffic_filtering=True,id=1de9bd20-d200-4afe-8d90-9897f7bb11df,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9bd20-d2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG os_vif [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:95:2b,bridge_name='br-int',has_traffic_filtering=True,id=1de9bd20-d200-4afe-8d90-9897f7bb11df,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9bd20-d2') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1de9bd20-d2, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1de9bd20-d2, col_values=(('external_ids', {'iface-id': '1de9bd20-d200-4afe-8d90-9897f7bb11df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:95:2b', 'vm-uuid': '5e9b37ae-ec75-4617-bc58-acb1a4b8b265'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:36 user nova-compute[70374]: INFO os_vif [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:95:2b,bridge_name='br-int',has_traffic_filtering=True,id=1de9bd20-d200-4afe-8d90-9897f7bb11df,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9bd20-d2')
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:15:36 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] No VIF found with MAC fa:16:3e:7b:95:2b, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-ce5a16ff-3f8c-4b71-896d-71d6f918d9bb req-a57a4497-cfb7-49c7-b8b7-c80b34489318 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ce5a16ff-3f8c-4b71-896d-71d6f918d9bb req-a57a4497-cfb7-49c7-b8b7-c80b34489318 service nova] Acquiring lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ce5a16ff-3f8c-4b71-896d-71d6f918d9bb req-a57a4497-cfb7-49c7-b8b7-c80b34489318 service nova] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-ce5a16ff-3f8c-4b71-896d-71d6f918d9bb req-a57a4497-cfb7-49c7-b8b7-c80b34489318 service nova] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG nova.compute.manager [req-ce5a16ff-3f8c-4b71-896d-71d6f918d9bb req-a57a4497-cfb7-49c7-b8b7-c80b34489318 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] No waiting events found dispatching network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:15:38 user nova-compute[70374]: WARNING nova.compute.manager [req-ce5a16ff-3f8c-4b71-896d-71d6f918d9bb req-a57a4497-cfb7-49c7-b8b7-c80b34489318 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received unexpected event network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df for instance with vm_state building and task_state spawning.
Jul 27 10:15:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:39 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:39 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452940.3040428, 5e9b37ae-ec75-4617-bc58-acb1a4b8b265 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:15:40 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] VM Resumed (Lifecycle Event)
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:15:40 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Instance spawned successfully.
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:15:40 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690452940.3053684, 5e9b37ae-ec75-4617-bc58-acb1a4b8b265 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:15:40 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] VM Started (Lifecycle Event)
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:15:40 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:15:40 user nova-compute[70374]: INFO nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Took 4.99 seconds to spawn the instance on the hypervisor.
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:15:40 user nova-compute[70374]: INFO nova.compute.manager [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Took 16.24 seconds to build instance.
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-bc811b3e-164b-4f06-bd09-462d7d75d68b req-cbfc4677-e53d-491d-80b6-ebd7ef189fe4 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc811b3e-164b-4f06-bd09-462d7d75d68b req-cbfc4677-e53d-491d-80b6-ebd7ef189fe4 service nova] Acquiring lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc811b3e-164b-4f06-bd09-462d7d75d68b req-cbfc4677-e53d-491d-80b6-ebd7ef189fe4 service nova] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bc811b3e-164b-4f06-bd09-462d7d75d68b req-cbfc4677-e53d-491d-80b6-ebd7ef189fe4 service nova] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG nova.compute.manager [req-bc811b3e-164b-4f06-bd09-462d7d75d68b req-cbfc4677-e53d-491d-80b6-ebd7ef189fe4 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] No waiting events found dispatching network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:15:40 user nova-compute[70374]: WARNING nova.compute.manager [req-bc811b3e-164b-4f06-bd09-462d7d75d68b req-cbfc4677-e53d-491d-80b6-ebd7ef189fe4 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received unexpected event network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df for instance with vm_state active and task_state None.
Jul 27 10:15:40 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-38e2940a-46b9-4f21-a480-d232bcbba3bc tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.333s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:15:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-bd833fb4-c4c9-4564-81db-cbcb11cfce41 req-43d7c7d0-d881-43c3-a2ea-b1e952b4e790 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-bd833fb4-c4c9-4564-81db-cbcb11cfce41 req-43d7c7d0-d881-43c3-a2ea-b1e952b4e790 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing instance network info cache due to event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd833fb4-c4c9-4564-81db-cbcb11cfce41 req-43d7c7d0-d881-43c3-a2ea-b1e952b4e790 service nova] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd833fb4-c4c9-4564-81db-cbcb11cfce41 req-43d7c7d0-d881-43c3-a2ea-b1e952b4e790 service nova] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG nova.network.neutron [req-bd833fb4-c4c9-4564-81db-cbcb11cfce41 req-43d7c7d0-d881-43c3-a2ea-b1e952b4e790 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG nova.network.neutron [req-bd833fb4-c4c9-4564-81db-cbcb11cfce41 req-43d7c7d0-d881-43c3-a2ea-b1e952b4e790 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updated VIF entry in instance network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG nova.network.neutron [req-bd833fb4-c4c9-4564-81db-cbcb11cfce41 req-43d7c7d0-d881-43c3-a2ea-b1e952b4e790 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bd833fb4-c4c9-4564-81db-cbcb11cfce41 req-43d7c7d0-d881-43c3-a2ea-b1e952b4e790 service nova] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:42 user nova-compute[70374]: INFO nova.compute.manager [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Shelve offloading
Jul 27 10:15:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:43 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance destroyed successfully.
Jul 27 10:15:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:15:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:15:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:15:43 user nova-compute[70374]: DEBUG nova.network.neutron [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.network.neutron [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-unplugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] No waiting events found dispatching network-vif-unplugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:15:44 user nova-compute[70374]: WARNING nova.compute.manager [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received unexpected event network-vif-unplugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 for instance with vm_state active and task_state shelving.
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] No waiting events found dispatching network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:15:44 user nova-compute[70374]: WARNING nova.compute.manager [req-70e4a3ec-b156-4dac-bbfe-bb5a3cdc8c0c req-ab7aa2d1-2dcf-443a-9d6c-ab309a8cc6ad service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received unexpected event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 for instance with vm_state active and task_state shelving.
Jul 27 10:15:44 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance destroyed successfully.
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lazy-loading 'resources' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1242647726',display_name='tempest-TestShelveInstance-server-1242647726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1242647726',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwYnLwtSeXA4dbtUMnzj2pbLq3APrmZhFkUd2cKju6Iub+rQ76xbtRzBwY0lzlgKd4kL22hu/gQ+Tw85SVQvI2js0zhmhX7sYTGvrXcvSl6fAb/5mO+NtL3nsi1XhJWCA==',key_name='tempest-TestShelveInstance-372801412',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:14:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f18ab7fd5474bae9826302b087d6135',ramdisk_id='',reservation_id='r-dna1hw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1997463019',owner_user_name='tempest-TestShelveInstance-1997463019-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:14:02Z,user_data=None,user_id='e79bd5dd4f75439194c8f653b0b324b7',uuid=513b0d57-db1f-4d0e-805e-013c6331ebcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converting VIF {"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_vif [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67f43f65-0c, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:15:44 user nova-compute[70374]: INFO os_vif [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c')
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-3865f439-8a33-4011-bfbd-ea3c2e5ca091 req-7ef33d7e-56b6-49ef-90ad-057f2b660a68 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.compute.manager [req-3865f439-8a33-4011-bfbd-ea3c2e5ca091 req-7ef33d7e-56b6-49ef-90ad-057f2b660a68 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing instance network info cache due to event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3865f439-8a33-4011-bfbd-ea3c2e5ca091 req-7ef33d7e-56b6-49ef-90ad-057f2b660a68 service nova] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3865f439-8a33-4011-bfbd-ea3c2e5ca091 req-7ef33d7e-56b6-49ef-90ad-057f2b660a68 service nova] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.network.neutron [req-3865f439-8a33-4011-bfbd-ea3c2e5ca091 req-7ef33d7e-56b6-49ef-90ad-057f2b660a68 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvXzTCIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:15:44 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[875fa4e2-c201-4702-9640-30f341daeb3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:15:44 user nova-compute[70374]: No targets found.
Jul 27 10:15:44 user nova-compute[70374]: iSNS:
Jul 27 10:15:44 user nova-compute[70374]: No targets found.
Jul 27 10:15:44 user nova-compute[70374]: STATIC:
Jul 27 10:15:44 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c
Jul 27 10:15:44 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:15:44 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:15:44 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3
Jul 27 10:15:44 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:15:44 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:15:44 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506
Jul 27 10:15:44 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:15:44 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:15:44 user nova-compute[70374]: FIRMWARE:
Jul 27 10:15:44 user nova-compute[70374]: No targets found.
Jul 27 10:15:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:15:44 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:15:44 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0deb23-4f2e-4529-bb1f-4ad2b54a35d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b087a7-8729-488f-9284-1561e55d33e4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:15:44 user nova-compute[70374]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:15:44 user nova-compute[70374]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)
Jul 27 10:15:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:15:44 user nova-compute[70374]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:15:44 user nova-compute[70374]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)
Jul 27 10:15:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc3cb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5ae976-ffcf-4e72-840d-b7dcede7986a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3052d7a-dbf3-4224-af19-775e699f763a]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9598419-4558-4515-91e0-e46559fa5996]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[800d9850-5686-484f-8ff4-b2efdc46033d]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef61270a-367b-4dc5-935b-3c3f24263a73]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[432ed267-b265-4388-a7f3-1a7161746c32]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260]
Jul 27 10:15:44 user nova-compute[70374]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260] successful.
Jul 27 10:15:44 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:44 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7162fc-fb80-4417-b0e3-ddc5a6d31c13]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] <== disconnect_volume: return (313ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:15:45 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Deleting instance files /opt/stack/data/nova/instances/513b0d57-db1f-4d0e-805e-013c6331ebcd_del
Jul 27 10:15:45 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Deletion of /opt/stack/data/nova/instances/513b0d57-db1f-4d0e-805e-013c6331ebcd_del complete
Jul 27 10:15:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-3865f439-8a33-4011-bfbd-ea3c2e5ca091 req-7ef33d7e-56b6-49ef-90ad-057f2b660a68 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updated VIF entry in instance network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG nova.network.neutron [req-3865f439-8a33-4011-bfbd-ea3c2e5ca091 req-7ef33d7e-56b6-49ef-90ad-057f2b660a68 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": null, "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap67f43f65-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-3865f439-8a33-4011-bfbd-ea3c2e5ca091 req-7ef33d7e-56b6-49ef-90ad-057f2b660a68 service nova] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:15:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:45 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Deleted allocations for instance 513b0d57-db1f-4d0e-805e-013c6331ebcd
Jul 27 10:15:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lazy-loading 'numa_topology' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:15:46 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:15:46 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:15:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9baf8bc-95a5-483a-91f4-5597159eba9e tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.429s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:46 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:48 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:15:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:15:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8600MB free_disk=25.242156982421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 5e9b37ae-ec75-4617-bc58-acb1a4b8b265 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:15:51 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:15:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:15:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:15:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:15:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:15:58 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690452943.5706131, 513b0d57-db1f-4d0e-805e-013c6331ebcd => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:15:58 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] VM Stopped (Lifecycle Event)
Jul 27 10:15:58 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5f28f3ea-b19b-4fc7-9990-ca375158761c None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:15:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:16:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:16:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:16:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:16:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:29 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:16:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:39 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating instance_info_cache with network_info: [{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:16:42 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:16:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:16:46 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:16:50 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:16:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:16:51 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:16:51 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=25.241477966308594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:16:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 5e9b37ae-ec75-4617-bc58-acb1a4b8b265 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 10:16:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 10:16:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:16:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:16:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:04 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:04 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 10:17:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_power_states {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 5e9b37ae-ec75-4617-bc58-acb1a4b8b265 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:12 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:13 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:16 user nova-compute[70374]: DEBUG nova.compute.manager [req-da4cce8a-fcc9-44e4-9915-3907a2e60dd7 req-15d9da6c-79be-4732-8216-2f30a309b0b8 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-changed-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:17:16 user nova-compute[70374]: DEBUG nova.compute.manager [req-da4cce8a-fcc9-44e4-9915-3907a2e60dd7 req-15d9da6c-79be-4732-8216-2f30a309b0b8 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Refreshing instance network info cache due to event network-changed-1de9bd20-d200-4afe-8d90-9897f7bb11df. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:17:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-da4cce8a-fcc9-44e4-9915-3907a2e60dd7 req-15d9da6c-79be-4732-8216-2f30a309b0b8 service nova] Acquiring lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:17:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-da4cce8a-fcc9-44e4-9915-3907a2e60dd7 req-15d9da6c-79be-4732-8216-2f30a309b0b8 service nova] Acquired lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:17:16 user nova-compute[70374]: DEBUG nova.network.neutron [req-da4cce8a-fcc9-44e4-9915-3907a2e60dd7 req-15d9da6c-79be-4732-8216-2f30a309b0b8 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Refreshing network info cache for port 1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:17:16 user nova-compute[70374]: DEBUG nova.network.neutron [req-da4cce8a-fcc9-44e4-9915-3907a2e60dd7 req-15d9da6c-79be-4732-8216-2f30a309b0b8 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updated VIF entry in instance network info cache for port 1de9bd20-d200-4afe-8d90-9897f7bb11df. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:17:16 user nova-compute[70374]: DEBUG nova.network.neutron [req-da4cce8a-fcc9-44e4-9915-3907a2e60dd7 req-15d9da6c-79be-4732-8216-2f30a309b0b8 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updating instance_info_cache with network_info: [{"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:17:16 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-da4cce8a-fcc9-44e4-9915-3907a2e60dd7 req-15d9da6c-79be-4732-8216-2f30a309b0b8 service nova] Releasing lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:17:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:17 user nova-compute[70374]: INFO nova.compute.manager [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Terminating instance
Jul 27 10:17:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-0d6fbacd-c166-4ccc-a160-b30221ff6c77 req-64a7c0b8-f972-4a5d-a86d-af849b7794a5 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-changed-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG nova.compute.manager [req-0d6fbacd-c166-4ccc-a160-b30221ff6c77 req-64a7c0b8-f972-4a5d-a86d-af849b7794a5 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Refreshing instance network info cache due to event network-changed-1de9bd20-d200-4afe-8d90-9897f7bb11df. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0d6fbacd-c166-4ccc-a160-b30221ff6c77 req-64a7c0b8-f972-4a5d-a86d-af849b7794a5 service nova] Acquiring lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0d6fbacd-c166-4ccc-a160-b30221ff6c77 req-64a7c0b8-f972-4a5d-a86d-af849b7794a5 service nova] Acquired lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG nova.network.neutron [req-0d6fbacd-c166-4ccc-a160-b30221ff6c77 req-64a7c0b8-f972-4a5d-a86d-af849b7794a5 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Refreshing network info cache for port 1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Instance destroyed successfully.
Jul 27 10:17:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'resources' on Instance uuid 5e9b37ae-ec75-4617-bc58-acb1a4b8b265 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-390712598',display_name='tempest-TestVolumeBootPattern-server-390712598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-390712598',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-t5tum745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:15:40Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=5e9b37ae-ec75-4617-bc58-acb1a4b8b265,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:95:2b,bridge_name='br-int',has_traffic_filtering=True,id=1de9bd20-d200-4afe-8d90-9897f7bb11df,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9bd20-d2') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_vif [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:95:2b,bridge_name='br-int',has_traffic_filtering=True,id=1de9bd20-d200-4afe-8d90-9897f7bb11df,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9bd20-d2') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1de9bd20-d2, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:18 user nova-compute[70374]: INFO os_vif [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:95:2b,bridge_name='br-int',has_traffic_filtering=True,id=1de9bd20-d200-4afe-8d90-9897f7bb11df,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de9bd20-d2')
Jul 27 10:17:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoTAmDGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:17:18 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a78398-fdde-4458-9ecc-7be783ad3a65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:17:18 user nova-compute[70374]: No targets found.
Jul 27 10:17:18 user nova-compute[70374]: iSNS:
Jul 27 10:17:18 user nova-compute[70374]: No targets found.
Jul 27 10:17:18 user nova-compute[70374]: STATIC:
Jul 27 10:17:18 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c
Jul 27 10:17:18 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:17:18 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:17:18 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506
Jul 27 10:17:18 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:17:18 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:17:18 user nova-compute[70374]: FIRMWARE:
Jul 27 10:17:18 user nova-compute[70374]: No targets found.
Jul 27 10:17:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:17:18 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:17:18 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d12dced-ca7e-4799-97e1-01d5ed15b9c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9597e7d0-267b-414f-8398-3db665619dc2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:17:18 user nova-compute[70374]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)
Jul 27 10:17:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:17:18 user nova-compute[70374]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c (non-flash)
Jul 27 10:17:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5d4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c'): ({'sdd'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Removing single pathed devices sdd {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a3f91-c42d-4e7d-9747-b8bfaa43ab5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019e67b-065f-4111-9474-9e64d8871d93]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flushing IO for device /dev/sdd {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbbd14d-e4f0-47db-a4db-4b5d61ac48ef]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5759e712-386d-4c8f-9a0f-1433c7ce7ea4]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] SCSI volumes sdd have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ecd961-36aa-4f22-9ef7-388237165fae]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc27e228-eadb-450a-adc2-740e0f084f90]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c, portal: 172.16.0.220,3260]
Jul 27 10:17:19 user nova-compute[70374]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c, portal: 172.16.0.220,3260] successful.
Jul 27 10:17:19 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09327b25-7c6b-41e6-9046-5c32b818ac9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c60d0-ee97-4cd9-9e87-40477c7bcabd]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== disconnect_volume: return (283ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:17:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Deleting instance files /opt/stack/data/nova/instances/5e9b37ae-ec75-4617-bc58-acb1a4b8b265_del
Jul 27 10:17:19 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Deletion of /opt/stack/data/nova/instances/5e9b37ae-ec75-4617-bc58-acb1a4b8b265_del complete
Jul 27 10:17:19 user nova-compute[70374]: DEBUG nova.network.neutron [req-0d6fbacd-c166-4ccc-a160-b30221ff6c77 req-64a7c0b8-f972-4a5d-a86d-af849b7794a5 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updated VIF entry in instance network info cache for port 1de9bd20-d200-4afe-8d90-9897f7bb11df. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG nova.network.neutron [req-0d6fbacd-c166-4ccc-a160-b30221ff6c77 req-64a7c0b8-f972-4a5d-a86d-af849b7794a5 service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updating instance_info_cache with network_info: [{"id": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "address": "fa:16:3e:7b:95:2b", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de9bd20-d2", "ovs_interfaceid": "1de9bd20-d200-4afe-8d90-9897f7bb11df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:17:19 user nova-compute[70374]: INFO nova.compute.manager [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 27 10:17:19 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-0d6fbacd-c166-4ccc-a160-b30221ff6c77 req-64a7c0b8-f972-4a5d-a86d-af849b7794a5 service nova] Releasing lock "refresh_cache-5e9b37ae-ec75-4617-bc58-acb1a4b8b265" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:17:19 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:17:19 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Took 0.43 seconds to deallocate network for instance.
Jul 27 10:17:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-vif-unplugged-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] Acquiring lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] No waiting events found dispatching network-vif-unplugged-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-vif-unplugged-1de9bd20-d200-4afe-8d90-9897f7bb11df for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] Acquiring lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] No waiting events found dispatching network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:17:20 user nova-compute[70374]: WARNING nova.compute.manager [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received unexpected event network-vif-plugged-1de9bd20-d200-4afe-8d90-9897f7bb11df for instance with vm_state active and task_state deleting.
Jul 27 10:17:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-f75beb00-93ef-4661-948f-5bd07f818c7f req-c3ce1d8f-d8ac-4ebd-9192-dade2d5b6bbe service nova] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Received event network-vif-deleted-1de9bd20-d200-4afe-8d90-9897f7bb11df {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:17:20 user nova-compute[70374]: INFO nova.compute.manager [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Took 0.72 seconds to detach 1 volumes for instance.
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:20 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Deleted allocations for instance 5e9b37ae-ec75-4617-bc58-acb1a4b8b265
Jul 27 10:17:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-c9813ae3-4235-44fd-9361-80434073c838 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "5e9b37ae-ec75-4617-bc58-acb1a4b8b265" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:17:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:17:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:17:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:33 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690453038.7239816, 5e9b37ae-ec75-4617-bc58-acb1a4b8b265 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:17:33 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] VM Stopped (Lifecycle Event)
Jul 27 10:17:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-2483f447-07f2-4399-8d7f-d329b0ca32d6 None None] [instance: 5e9b37ae-ec75-4617-bc58-acb1a4b8b265] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:17:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:34 user nova-compute[70374]: INFO nova.compute.manager [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Unshelving
Jul 27 10:17:34 user nova-compute[70374]: INFO nova.virt.block_device [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Booting with volume 72fbbc0b-d857-4b51-817c-2895eeedb4a3 at /dev/vda
Jul 27 10:17:34 user nova-compute[70374]: DEBUG os_brick.utils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4b7bd6-29b0-4ba6-b905-5b2f4e1d8a91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faabb28-7210-430a-8e75-cf52b903bd96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[313b24b6-a34d-4130-b817-1d531529364e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a998277-7819-4fcc-8949-11a62ec78405]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:17:34 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:17:34 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2aa01d-ab21-4d33-a362-8f9f4a59a8ce]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG os_brick.utils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:17:34 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating existing volume attachment record: 176bf28e-8778-4519-ae78-89067f28f695 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:17:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:41 user nova-compute[70374]: DEBUG nova.objects.instance [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lazy-loading 'pci_requests' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:17:41 user nova-compute[70374]: DEBUG nova.objects.instance [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lazy-loading 'numa_topology' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:17:41 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:17:41 user nova-compute[70374]: INFO nova.compute.claims [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Claim successful on node user
Jul 27 10:17:41 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:17:41 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:17:41 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:41 user nova-compute[70374]: INFO nova.network.neutron [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf2d6992-a433-438a-856e-8c48e6dd9b1f req-e869ab78-16c5-4445-a0a9-b69ea61a7c85 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.compute.manager [req-bf2d6992-a433-438a-856e-8c48e6dd9b1f req-e869ab78-16c5-4445-a0a9-b69ea61a7c85 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing instance network info cache due to event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf2d6992-a433-438a-856e-8c48e6dd9b1f req-e869ab78-16c5-4445-a0a9-b69ea61a7c85 service nova] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.network.neutron [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:17:42 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Creating image(s)
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Did not create local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Ensure instance console log exists: /opt/stack/data/nova/instances/513b0d57-db1f-4d0e-805e-013c6331ebcd/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Start _get_guest_xml network_info=[{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'attachment_id': '176bf28e-8778-4519-ae78-89067f28f695', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvXzTCIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '513b0d57-db1f-4d0e-805e-013c6331ebcd', 'attached_at': '', 'detached_at': '', 'volume_id': '72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'serial': '72fbbc0b-d857-4b51-817c-2895eeedb4a3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf2d6992-a433-438a-856e-8c48e6dd9b1f req-e869ab78-16c5-4445-a0a9-b69ea61a7c85 service nova] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.network.neutron [req-bf2d6992-a433-438a-856e-8c48e6dd9b1f req-e869ab78-16c5-4445-a0a9-b69ea61a7c85 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:17:42 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:17:42 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.objects.instance [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lazy-loading 'vcpu_model' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvXzTCIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:17:42 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:17:42 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:17:42 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[37818cda-27eb-43f2-a0c9-264e82fc73e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:17:42 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d4ec8-6ea1-4666-acc5-06f95599821a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3] added
Jul 27 10:17:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc5ca4-40c5-4187-8cc7-256794d83a41]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef56cc-0081-49c2-b4f6-9bf8432e51ec]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvXzTCIj {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvXzTCIj" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1480ba-b7b9-473b-862a-4b611b24b869]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VvXzTCIj'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38aa5b7-233d-40a0-aa12-71b6c8e0784c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5023de85-3d87-405b-a7d2-6db68b05bbce]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:17:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:17:42 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:17:42 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aa1407-14a1-4aec-973b-82417c17cabb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260]
Jul 27 10:17:43 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260] successful.
Jul 27 10:17:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e9c65c-98ef-4146-a811-8ccb72ca78f4]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2334c079-f665-4af1-8664-7d594fc15fd5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:17:43 user nova-compute[70374]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:17:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:17:43 user nova-compute[70374]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:17:43 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[889f86fb-323d-42a2-9a39-b198adfa1229]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-bf2d6992-a433-438a-856e-8c48e6dd9b1f req-e869ab78-16c5-4445-a0a9-b69ea61a7c85 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updated VIF entry in instance network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG nova.network.neutron [req-bf2d6992-a433-438a-856e-8c48e6dd9b1f req-e869ab78-16c5-4445-a0a9-b69ea61a7c85 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-bf2d6992-a433-438a-856e-8c48e6dd9b1f req-e869ab78-16c5-4445-a0a9-b69ea61a7c85 service nova] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:17:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvXzTCIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23732616162633438', 'path': '/dev/sdc'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732616162633438', 'path': '/dev/sdc'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T10:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1242647726',display_name='tempest-TestShelveInstance-server-1242647726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1242647726',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-372801412',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:14:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7f18ab7fd5474bae9826302b087d6135',ramdisk_id='',reservation_id='r-dna1hw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1997463019',owner_user_name='tempest-TestShelveInstance-1997463019-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:17:34Z,user_data=None,user_id='e79bd5dd4f75439194c8f653b0b324b7',uuid=513b0d57-db1f-4d0e-805e-013c6331ebcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converting VIF {"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lazy-loading 'pci_devices' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:17:44 user nova-compute[70374]:   <uuid>513b0d57-db1f-4d0e-805e-013c6331ebcd</uuid>
Jul 27 10:17:44 user nova-compute[70374]:   <name>instance-00000031</name>
Jul 27 10:17:44 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:17:44 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:17:44 user nova-compute[70374]:   <metadata>
Jul 27 10:17:44 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:17:44 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:17:44 user nova-compute[70374]:       <nova:name>tempest-TestShelveInstance-server-1242647726</nova:name>
Jul 27 10:17:44 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:17:42</nova:creationTime>
Jul 27 10:17:44 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:17:44 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:17:44 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:17:44 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:17:44 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:17:44 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:17:44 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:17:44 user nova-compute[70374]:       <nova:owner>
Jul 27 10:17:44 user nova-compute[70374]:         <nova:user uuid="e79bd5dd4f75439194c8f653b0b324b7">tempest-TestShelveInstance-1997463019-project-member</nova:user>
Jul 27 10:17:44 user nova-compute[70374]:         <nova:project uuid="7f18ab7fd5474bae9826302b087d6135">tempest-TestShelveInstance-1997463019</nova:project>
Jul 27 10:17:44 user nova-compute[70374]:       </nova:owner>
Jul 27 10:17:44 user nova-compute[70374]:       <nova:ports>
Jul 27 10:17:44 user nova-compute[70374]:         <nova:port uuid="67f43f65-0c9d-41a0-ac07-bdd7ebd91f39">
Jul 27 10:17:44 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 10:17:44 user nova-compute[70374]:         </nova:port>
Jul 27 10:17:44 user nova-compute[70374]:       </nova:ports>
Jul 27 10:17:44 user nova-compute[70374]:     </nova:instance>
Jul 27 10:17:44 user nova-compute[70374]:   </metadata>
Jul 27 10:17:44 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:17:44 user nova-compute[70374]:     <system>
Jul 27 10:17:44 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:17:44 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:17:44 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:17:44 user nova-compute[70374]:       <entry name="serial">513b0d57-db1f-4d0e-805e-013c6331ebcd</entry>
Jul 27 10:17:44 user nova-compute[70374]:       <entry name="uuid">513b0d57-db1f-4d0e-805e-013c6331ebcd</entry>
Jul 27 10:17:44 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:17:44 user nova-compute[70374]:     </system>
Jul 27 10:17:44 user nova-compute[70374]:   </sysinfo>
Jul 27 10:17:44 user nova-compute[70374]:   <os>
Jul 27 10:17:44 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:17:44 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:17:44 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:17:44 user nova-compute[70374]:   </os>
Jul 27 10:17:44 user nova-compute[70374]:   <features>
Jul 27 10:17:44 user nova-compute[70374]:     <acpi/>
Jul 27 10:17:44 user nova-compute[70374]:     <apic/>
Jul 27 10:17:44 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:17:44 user nova-compute[70374]:   </features>
Jul 27 10:17:44 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:17:44 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:17:44 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:17:44 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:17:44 user nova-compute[70374]:   </clock>
Jul 27 10:17:44 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:17:44 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:17:44 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:17:44 user nova-compute[70374]:   </cpu>
Jul 27 10:17:44 user nova-compute[70374]:   <devices>
Jul 27 10:17:44 user nova-compute[70374]:     <disk type="block" device="disk">
Jul 27 10:17:44 user nova-compute[70374]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:17:44 user nova-compute[70374]:       <source dev="/dev/sdc"/>
Jul 27 10:17:44 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:17:44 user nova-compute[70374]:       <serial>72fbbc0b-d857-4b51-817c-2895eeedb4a3</serial>
Jul 27 10:17:44 user nova-compute[70374]:     </disk>
Jul 27 10:17:44 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:17:44 user nova-compute[70374]:       <mac address="fa:16:3e:a4:2f:c7"/>
Jul 27 10:17:44 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:17:44 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:17:44 user nova-compute[70374]:       <target dev="tap67f43f65-0c"/>
Jul 27 10:17:44 user nova-compute[70374]:     </interface>
Jul 27 10:17:44 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:17:44 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/513b0d57-db1f-4d0e-805e-013c6331ebcd/console.log" append="off"/>
Jul 27 10:17:44 user nova-compute[70374]:     </serial>
Jul 27 10:17:44 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:17:44 user nova-compute[70374]:     <video>
Jul 27 10:17:44 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:17:44 user nova-compute[70374]:     </video>
Jul 27 10:17:44 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:17:44 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:17:44 user nova-compute[70374]:     </rng>
Jul 27 10:17:44 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:17:44 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:17:44 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:17:44 user nova-compute[70374]:     </memballoon>
Jul 27 10:17:44 user nova-compute[70374]:   </devices>
Jul 27 10:17:44 user nova-compute[70374]: </domain>
Jul 27 10:17:44 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T10:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1242647726',display_name='tempest-TestShelveInstance-server-1242647726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1242647726',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-372801412',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:14:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7f18ab7fd5474bae9826302b087d6135',ramdisk_id='',reservation_id='r-dna1hw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1997463019',owner_user_name='tempest-TestShelveInstance-1997463019-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:17:34Z,user_data=None,user_id='e79bd5dd4f75439194c8f653b0b324b7',uuid=513b0d57-db1f-4d0e-805e-013c6331ebcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converting VIF {"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG os_vif [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67f43f65-0c, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67f43f65-0c, col_values=(('external_ids', {'iface-id': '67f43f65-0c9d-41a0-ac07-bdd7ebd91f39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:2f:c7', 'vm-uuid': '513b0d57-db1f-4d0e-805e-013c6331ebcd'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:44 user nova-compute[70374]: INFO os_vif [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c')
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] No VIF found with MAC fa:16:3e:a4:2f:c7, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:17:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-39b5ab48-2026-444d-a490-a4f50a60e741 req-7520a805-d91b-49c9-a14a-07eb6a7bd25c service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39b5ab48-2026-444d-a490-a4f50a60e741 req-7520a805-d91b-49c9-a14a-07eb6a7bd25c service nova] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39b5ab48-2026-444d-a490-a4f50a60e741 req-7520a805-d91b-49c9-a14a-07eb6a7bd25c service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-39b5ab48-2026-444d-a490-a4f50a60e741 req-7520a805-d91b-49c9-a14a-07eb6a7bd25c service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG nova.compute.manager [req-39b5ab48-2026-444d-a490-a4f50a60e741 req-7520a805-d91b-49c9-a14a-07eb6a7bd25c service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] No waiting events found dispatching network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:17:45 user nova-compute[70374]: WARNING nova.compute.manager [req-39b5ab48-2026-444d-a490-a4f50a60e741 req-7520a805-d91b-49c9-a14a-07eb6a7bd25c service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received unexpected event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 10:17:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690453067.4769866, 513b0d57-db1f-4d0e-805e-013c6331ebcd => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:17:47 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] VM Resumed (Lifecycle Event)
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:17:47 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance spawned successfully.
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:17:47 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690453067.4790893, 513b0d57-db1f-4d0e-805e-013c6331ebcd => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:17:47 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] VM Started (Lifecycle Event)
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-83a272e3-b6ba-4af2-8828-9b1ea0aefd8c tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.208s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-4c4cf60e-f102-4b35-a414-d4bcd902fce7 req-12bcf35d-ae19-4937-a7b2-976efd44f139 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4c4cf60e-f102-4b35-a414-d4bcd902fce7 req-12bcf35d-ae19-4937-a7b2-976efd44f139 service nova] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4c4cf60e-f102-4b35-a414-d4bcd902fce7 req-12bcf35d-ae19-4937-a7b2-976efd44f139 service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4c4cf60e-f102-4b35-a414-d4bcd902fce7 req-12bcf35d-ae19-4937-a7b2-976efd44f139 service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:47 user nova-compute[70374]: DEBUG nova.compute.manager [req-4c4cf60e-f102-4b35-a414-d4bcd902fce7 req-12bcf35d-ae19-4937-a7b2-976efd44f139 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] No waiting events found dispatching network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:17:47 user nova-compute[70374]: WARNING nova.compute.manager [req-4c4cf60e-f102-4b35-a414-d4bcd902fce7 req-12bcf35d-ae19-4937-a7b2-976efd44f139 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received unexpected event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 for instance with vm_state active and task_state None.
Jul 27 10:17:49 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:17:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:17:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=25.239635467529297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 513b0d57-db1f-4d0e-805e-013c6331ebcd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:17:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:17:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:17:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:17:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:17:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:17:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:17:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:17:59 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:04 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:09 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:10 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-4eebed39-8aac-4146-b23b-13700fc58be3 req-edcec6d0-9cb6-436a-98af-125ffe57a9d5 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-changed-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG nova.compute.manager [req-4eebed39-8aac-4146-b23b-13700fc58be3 req-edcec6d0-9cb6-436a-98af-125ffe57a9d5 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Refreshing instance network info cache due to event network-changed-b394486c-5c3f-4ec1-966f-261cf4a75107. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4eebed39-8aac-4146-b23b-13700fc58be3 req-edcec6d0-9cb6-436a-98af-125ffe57a9d5 service nova] Acquiring lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4eebed39-8aac-4146-b23b-13700fc58be3 req-edcec6d0-9cb6-436a-98af-125ffe57a9d5 service nova] Acquired lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG nova.network.neutron [req-4eebed39-8aac-4146-b23b-13700fc58be3 req-edcec6d0-9cb6-436a-98af-125ffe57a9d5 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Refreshing network info cache for port b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:18:17 user nova-compute[70374]: INFO nova.compute.manager [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Terminating instance
Jul 27 10:18:17 user nova-compute[70374]: DEBUG nova.compute.manager [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.network.neutron [req-4eebed39-8aac-4146-b23b-13700fc58be3 req-edcec6d0-9cb6-436a-98af-125ffe57a9d5 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updated VIF entry in instance network info cache for port b394486c-5c3f-4ec1-966f-261cf4a75107. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.network.neutron [req-4eebed39-8aac-4146-b23b-13700fc58be3 req-edcec6d0-9cb6-436a-98af-125ffe57a9d5 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating instance_info_cache with network_info: [{"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-4eebed39-8aac-4146-b23b-13700fc58be3 req-edcec6d0-9cb6-436a-98af-125ffe57a9d5 service nova] Releasing lock "refresh_cache-25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:18:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Instance destroyed successfully.
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.objects.instance [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lazy-loading 'resources' on Instance uuid 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2004930609',display_name='tempest-TestVolumeBootPattern-server-2004930609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2004930609',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKOQIAKFPJSv+7/dKvHtRd3qRtr64qES/n12sbSR1nGrJXIQQmI0AkE7YVhPYYG8f98gQszcVgc5VzqAz97X8VAbRKgl/ZkxpFb2SblNkZw3JdgdPMrSTDEBwE+5Zyvag==',key_name='tempest-TestVolumeBootPattern-1753972775',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:13:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e1ff0e178842deba4c0efce3b84cf8',ramdisk_id='',reservation_id='r-wuv187wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-953954878',owner_user_name='tempest-TestVolumeBootPattern-953954878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:13:33Z,user_data=None,user_id='fc6e02625621443392a958dd87d679a3',uuid=25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converting VIF {"id": "b394486c-5c3f-4ec1-966f-261cf4a75107", "address": "fa:16:3e:41:15:3c", "network": {"id": "54884b6b-4d1d-472c-969e-d6d3df1b061b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-734066467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e1ff0e178842deba4c0efce3b84cf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb394486c-5c", "ovs_interfaceid": "b394486c-5c3f-4ec1-966f-261cf4a75107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:15:3c,bridge_name='br-int',has_traffic_filtering=True,id=b394486c-5c3f-4ec1-966f-261cf4a75107,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb394486c-5c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_vif [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:15:3c,bridge_name='br-int',has_traffic_filtering=True,id=b394486c-5c3f-4ec1-966f-261cf4a75107,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb394486c-5c') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb394486c-5c, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:18:18 user nova-compute[70374]: INFO os_vif [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:15:3c,bridge_name='br-int',has_traffic_filtering=True,id=b394486c-5c3f-4ec1-966f-261cf4a75107,network=Network(54884b6b-4d1d-472c-969e-d6d3df1b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb394486c-5c')
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyclJSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:18:18 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29afb5a-93c5-4244-85d2-31902b122c31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:18:18 user nova-compute[70374]: No targets found.
Jul 27 10:18:18 user nova-compute[70374]: iSNS:
Jul 27 10:18:18 user nova-compute[70374]: No targets found.
Jul 27 10:18:18 user nova-compute[70374]: STATIC:
Jul 27 10:18:18 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3
Jul 27 10:18:18 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:18:18 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:18:18 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506
Jul 27 10:18:18 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:18:18 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:18:18 user nova-compute[70374]: FIRMWARE:
Jul 27 10:18:18 user nova-compute[70374]: No targets found.
Jul 27 10:18:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:18:18 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:18:18 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d2081-4bac-4a41-b502-62f746d4ed81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9970dd0-f7a1-42c9-8477-dd881b18f715]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:18:18 user nova-compute[70374]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:18:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 (non-flash)
Jul 27 10:18:18 user nova-compute[70374]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:18:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27fc0e3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7148782-71e4-4b58-99ad-59941c2dfdbe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[65109863-080f-4b5c-85da-8f94099f4009]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6e6a88-4bd6-43a3-a462-bb587d36a102]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e34c38f-3d0e-4038-a7a4-dc1ad4c3fa22]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274c9b3-e658-4170-a557-a77d5d888bd1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ddb4af-ebe3-4737-88e2-4385d08ee401]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260]
Jul 27 10:18:18 user nova-compute[70374]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506, portal: 172.16.0.220,3260] successful.
Jul 27 10:18:18 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2852526d-fbf1-422b-bcf9-224b87411506 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56af506-8f72-4af2-843a-33226d55e147]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] <== disconnect_volume: return (307ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:18:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Deleting instance files /opt/stack/data/nova/instances/25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6_del
Jul 27 10:18:18 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Deletion of /opt/stack/data/nova/instances/25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6_del complete
Jul 27 10:18:18 user nova-compute[70374]: INFO nova.compute.manager [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 27 10:18:18 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:18:18 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:18:19 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Took 0.42 seconds to deallocate network for instance.
Jul 27 10:18:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-vif-unplugged-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] Acquiring lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] No waiting events found dispatching network-vif-unplugged-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-vif-unplugged-b394486c-5c3f-4ec1-966f-261cf4a75107 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] Acquiring lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:18:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] No waiting events found dispatching network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:18:19 user nova-compute[70374]: WARNING nova.compute.manager [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received unexpected event network-vif-plugged-b394486c-5c3f-4ec1-966f-261cf4a75107 for instance with vm_state active and task_state deleting.
Jul 27 10:18:19 user nova-compute[70374]: DEBUG nova.compute.manager [req-a2fda4eb-3453-47ea-9832-ef76a9a7e1e1 req-890c8815-9ee8-4144-93a2-b95b44bdad13 service nova] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Received event network-vif-deleted-b394486c-5c3f-4ec1-966f-261cf4a75107 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:18:20 user nova-compute[70374]: INFO nova.compute.manager [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Took 0.73 seconds to detach 1 volumes for instance.
Jul 27 10:18:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:18:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:18:20 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:18:20 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:18:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:18:20 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Deleted allocations for instance 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6
Jul 27 10:18:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-5e7e3e3b-9078-4946-919f-848d0a5bcb57 tempest-TestVolumeBootPattern-953954878 tempest-TestVolumeBootPattern-953954878-project-member] Lock "25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.629s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:18:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:18:33 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690453098.472523, 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:18:33 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] VM Stopped (Lifecycle Event)
Jul 27 10:18:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-8e83df6f-5b53-414a-bc81-3a5e5e07368d None None] [instance: 25548bec-7f75-44a2-8b4f-4b1a3cb0ecb6] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:18:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:18:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:18:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:18:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:18:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70374) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 10:18:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:18:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:18:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.238590240478516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 513b0d57-db1f-4d0e-805e-013c6331ebcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:18:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:18:53 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:18:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:18:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:18:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:56 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:18:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:19:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:19:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:19:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:19:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:19:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:19:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:19:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:19:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:19:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:19:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:19:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-2c4023ff-c70e-40e1-aa55-0c96b80dba0a req-1d5d10b4-8378-477f-bd74-f74f468fd0b9 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG nova.compute.manager [req-2c4023ff-c70e-40e1-aa55-0c96b80dba0a req-1d5d10b4-8378-477f-bd74-f74f468fd0b9 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing instance network info cache due to event network-changed-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2c4023ff-c70e-40e1-aa55-0c96b80dba0a req-1d5d10b4-8378-477f-bd74-f74f468fd0b9 service nova] Acquiring lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2c4023ff-c70e-40e1-aa55-0c96b80dba0a req-1d5d10b4-8378-477f-bd74-f74f468fd0b9 service nova] Acquired lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG nova.network.neutron [req-2c4023ff-c70e-40e1-aa55-0c96b80dba0a req-1d5d10b4-8378-477f-bd74-f74f468fd0b9 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Refreshing network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:19:25 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:19:25 user nova-compute[70374]: INFO nova.compute.manager [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Terminating instance
Jul 27 10:19:25 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-9df5c55e-53f2-451d-a0b3-74b8189b9ecb req-5442db93-1685-42a8-b2f4-26c10caba13a service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-unplugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9df5c55e-53f2-451d-a0b3-74b8189b9ecb req-5442db93-1685-42a8-b2f4-26c10caba13a service nova] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9df5c55e-53f2-451d-a0b3-74b8189b9ecb req-5442db93-1685-42a8-b2f4-26c10caba13a service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-9df5c55e-53f2-451d-a0b3-74b8189b9ecb req-5442db93-1685-42a8-b2f4-26c10caba13a service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-9df5c55e-53f2-451d-a0b3-74b8189b9ecb req-5442db93-1685-42a8-b2f4-26c10caba13a service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] No waiting events found dispatching network-vif-unplugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.compute.manager [req-9df5c55e-53f2-451d-a0b3-74b8189b9ecb req-5442db93-1685-42a8-b2f4-26c10caba13a service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-unplugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-2c4023ff-c70e-40e1-aa55-0c96b80dba0a req-1d5d10b4-8378-477f-bd74-f74f468fd0b9 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updated VIF entry in instance network info cache for port 67f43f65-0c9d-41a0-ac07-bdd7ebd91f39. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.network.neutron [req-2c4023ff-c70e-40e1-aa55-0c96b80dba0a req-1d5d10b4-8378-477f-bd74-f74f468fd0b9 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [{"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-2c4023ff-c70e-40e1-aa55-0c96b80dba0a req-1d5d10b4-8378-477f-bd74-f74f468fd0b9 service nova] Releasing lock "refresh_cache-513b0d57-db1f-4d0e-805e-013c6331ebcd" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:19:26 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Instance destroyed successfully.
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.objects.instance [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lazy-loading 'resources' on Instance uuid 513b0d57-db1f-4d0e-805e-013c6331ebcd {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T10:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1242647726',display_name='tempest-TestShelveInstance-server-1242647726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1242647726',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwYnLwtSeXA4dbtUMnzj2pbLq3APrmZhFkUd2cKju6Iub+rQ76xbtRzBwY0lzlgKd4kL22hu/gQ+Tw85SVQvI2js0zhmhX7sYTGvrXcvSl6fAb/5mO+NtL3nsi1XhJWCA==',key_name='tempest-TestShelveInstance-372801412',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:17:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f18ab7fd5474bae9826302b087d6135',ramdisk_id='',reservation_id='r-dna1hw0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1997463019',owner_user_name='tempest-TestShelveInstance-1997463019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:17:48Z,user_data=None,user_id='e79bd5dd4f75439194c8f653b0b324b7',uuid=513b0d57-db1f-4d0e-805e-013c6331ebcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converting VIF {"id": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "address": "fa:16:3e:a4:2f:c7", "network": {"id": "38d3c921-2304-4cdb-bbf3-245f4b0ccedc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1233285707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f18ab7fd5474bae9826302b087d6135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f43f65-0c", "ovs_interfaceid": "67f43f65-0c9d-41a0-ac07-bdd7ebd91f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_vif [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67f43f65-0c, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:26 user nova-compute[70374]: INFO os_vif [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:2f:c7,bridge_name='br-int',has_traffic_filtering=True,id=67f43f65-0c9d-41a0-ac07-bdd7ebd91f39,network=Network(38d3c921-2304-4cdb-bbf3-245f4b0ccedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f43f65-0c')
Jul 27 10:19:26 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvXzTCIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:19:26 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1694c44-bc6c-48ad-9f3f-bccbb632e07a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:19:26 user nova-compute[70374]: No targets found.
Jul 27 10:19:26 user nova-compute[70374]: iSNS:
Jul 27 10:19:26 user nova-compute[70374]: No targets found.
Jul 27 10:19:26 user nova-compute[70374]: STATIC:
Jul 27 10:19:26 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3
Jul 27 10:19:26 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:19:26 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:19:26 user nova-compute[70374]: FIRMWARE:
Jul 27 10:19:26 user nova-compute[70374]: No targets found.
Jul 27 10:19:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:19:26 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:19:26 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886af71-02ca-4184-bb00-87f5f8156d81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[440bd5a1-72f7-4d66-94d2-d3f070a6952f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:19:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 (non-flash)
Jul 27 10:19:26 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc3ace50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3'): ({'sdc'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Removing single pathed devices sdc {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff44e4-7689-4aa4-a782-d7489eb6b852]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[068786d3-2bb7-430a-b310-e7d5e309f213]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Flushing IO for device /dev/sdc {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282c7e9-0101-41b4-befa-66896802054e]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23447a3-7c0f-4b2e-af61-200b1ade79b1]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:19:26 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] SCSI volumes sdc have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfd32566d-72aabc481ba804ac', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fd32566d', '/dev/disk/by-id/scsi-23732616162633438') {{(pid=82164) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5cdf11-76c4-482e-806d-86e89c36fb0b]: (4, None) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b66ac8e-4adb-417f-b065-dc877444eaa9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[14759e12-3551-4d95-8f24-cd2fc7990811]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260]
Jul 27 10:19:27 user nova-compute[70374]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3, portal: 172.16.0.220,3260] successful.
Jul 27 10:19:27 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fbbc0b-d857-4b51-817c-2895eeedb4a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7019b-1f5c-438a-9349-a369df6280b6]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] <== disconnect_volume: return (311ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:19:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Deleting instance files /opt/stack/data/nova/instances/513b0d57-db1f-4d0e-805e-013c6331ebcd_del
Jul 27 10:19:27 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Deletion of /opt/stack/data/nova/instances/513b0d57-db1f-4d0e-805e-013c6331ebcd_del complete
Jul 27 10:19:27 user nova-compute[70374]: INFO nova.compute.manager [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 27 10:19:27 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:19:27 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:19:27 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Took 0.45 seconds to deallocate network for instance.
Jul 27 10:19:27 user nova-compute[70374]: DEBUG nova.compute.manager [req-5a1a7bc3-dc83-4943-aed5-d4c11cad016a req-468b54a0-88b8-4625-9d6e-ee8656e0d2ac service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-deleted-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-198f3ae0-0092-4e56-9112-d1b57b8af570 req-eaf91e3c-d97b-4e5c-a3b9-25baa27c8da1 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-198f3ae0-0092-4e56-9112-d1b57b8af570 req-eaf91e3c-d97b-4e5c-a3b9-25baa27c8da1 service nova] Acquiring lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-198f3ae0-0092-4e56-9112-d1b57b8af570 req-eaf91e3c-d97b-4e5c-a3b9-25baa27c8da1 service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-198f3ae0-0092-4e56-9112-d1b57b8af570 req-eaf91e3c-d97b-4e5c-a3b9-25baa27c8da1 service nova] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG nova.compute.manager [req-198f3ae0-0092-4e56-9112-d1b57b8af570 req-eaf91e3c-d97b-4e5c-a3b9-25baa27c8da1 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] No waiting events found dispatching network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:19:28 user nova-compute[70374]: WARNING nova.compute.manager [req-198f3ae0-0092-4e56-9112-d1b57b8af570 req-eaf91e3c-d97b-4e5c-a3b9-25baa27c8da1 service nova] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Received unexpected event network-vif-plugged-67f43f65-0c9d-41a0-ac07-bdd7ebd91f39 for instance with vm_state active and task_state deleting.
Jul 27 10:19:28 user nova-compute[70374]: INFO nova.compute.manager [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Took 0.73 seconds to detach 1 volumes for instance.
Jul 27 10:19:28 user nova-compute[70374]: DEBUG nova.compute.manager [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Deleting volume: 72fbbc0b-d857-4b51-817c-2895eeedb4a3 {{(pid=70374) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:19:28 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:19:28 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Deleted allocations for instance 513b0d57-db1f-4d0e-805e-013c6331ebcd
Jul 27 10:19:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cb0395d9-4962-45a7-9b96-0aec9b3e0599 tempest-TestShelveInstance-1997463019 tempest-TestShelveInstance-1997463019-project-member] Lock "513b0d57-db1f-4d0e-805e-013c6331ebcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.036s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:19:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:36 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:41 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690453166.7617292, 513b0d57-db1f-4d0e-805e-013c6331ebcd => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:19:41 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] VM Stopped (Lifecycle Event)
Jul 27 10:19:41 user nova-compute[70374]: DEBUG nova.compute.manager [None req-b1278a11-4377-463a-9801-65ce5442d09b None None] [instance: 513b0d57-db1f-4d0e-805e-013c6331ebcd] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:19:41 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:19:44 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:19:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:19:44 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 10:19:46 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:19:46 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:48 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:51 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:19:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:19:52 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:19:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=25.236289978027344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:19:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:19:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:19:56 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:19:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:14 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:15 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:19 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:21 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:26 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Starting instance... {{(pid=70374) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70374) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 10:20:29 user nova-compute[70374]: INFO nova.compute.claims [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Claim successful on node user
Jul 27 10:20:29 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Start building networks asynchronously for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Allocating IP information in the background. {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 10:20:29 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] allocate_for_instance() {{(pid=70374) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 10:20:29 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 10:20:29 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Start building block device mappings for instance. {{(pid=70374) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG nova.policy [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51563e190dfb4da2b572b5f392ef1798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33dd24825a734adaaebeaf4f369309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70374) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Start spawning the instance on the hypervisor. {{(pid=70374) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Creating instance directory {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 10:20:30 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Creating image(s)
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "/opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "/opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "/opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk 1073741824 {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1,backing_fmt=raw /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk 1073741824" returned: 0 in 0.058s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "eecbf4ea539212b0e09996b77db3066885fb0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eecbf4ea539212b0e09996b77db3066885fb0ed1 --force-share --output=json" returned: 0 in 0.145s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk. size=1073741824 {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG nova.virt.disk.api [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Cannot resize image /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk to a smaller size. {{(pid=70374) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'migration_context' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Created local disks {{(pid=70374) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Ensure instance console log exists: /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/console.log {{(pid=70374) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Successfully created port: 58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Successfully updated port: 58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Building network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-c9018da7-a33d-472c-abad-eddec80a7749 req-ec7218a3-f620-405d-9dbe-07c165b6a4ca service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received event network-changed-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG nova.compute.manager [req-c9018da7-a33d-472c-abad-eddec80a7749 req-ec7218a3-f620-405d-9dbe-07c165b6a4ca service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Refreshing instance network info cache due to event network-changed-58b78302-b6e5-483a-a57b-9abc88c95374. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c9018da7-a33d-472c-abad-eddec80a7749 req-ec7218a3-f620-405d-9dbe-07c165b6a4ca service nova] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:20:31 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Instance cache missing network info. {{(pid=70374) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.network.neutron [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Instance network_info: |[{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70374) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c9018da7-a33d-472c-abad-eddec80a7749 req-ec7218a3-f620-405d-9dbe-07c165b6a4ca service nova] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-c9018da7-a33d-472c-abad-eddec80a7749 req-ec7218a3-f620-405d-9dbe-07c165b6a4ca service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Refreshing network info cache for port 58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Start _get_guest_xml network_info=[{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '35458adf-261a-4e0b-a4db-b243619b2394'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 10:20:32 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:20:32 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] CPU controller missing on host. {{(pid=70374) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.host [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] CPU controller found on host. {{(pid=70374) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70374) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T09:26:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T09:26:27Z,direct_url=<?>,disk_format='qcow2',id=35458adf-261a-4e0b-a4db-b243619b2394,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='37aff788807d4b2aafc10d355583f7c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T09:26:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Flavor limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Image limits 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Flavor pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Image pref 0:0:0 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Got 1 possible topologies {{(pid=70374) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.hardware [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70374) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:20:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1783029299',display_name='tempest-SnapshotDataIntegrityTests-server-1783029299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1783029299',id=51,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+6/HxS1LtWajP4GzNjORxWg/w36mnu0Qd7nFTUgPTjagZ23Wz4zqmkLbU2+du9dcKL1G3yoHCKFYfFqQg033HJ2ULmSGWfSklOEkGOYSHe06wmuIYrpoWueC/gH3Vzw==',key_name='tempest-keypair-244904466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33dd24825a734adaaebeaf4f369309bc',ramdisk_id='',reservation_id='r-190gy0lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1391447189',owner_user_name='tempest-SnapshotDataIntegrityTests-1391447189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51563e190dfb4da2b572b5f392ef1798',uuid=71366ca3-fb7d-487d-b1a6-b7daa937e960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70374) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Converting VIF {"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:46:8c,bridge_name='br-int',has_traffic_filtering=True,id=58b78302-b6e5-483a-a57b-9abc88c95374,network=Network(de0e1c71-acd9-4caf-ae3c-36eaefca932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b78302-b6') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.objects.instance [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'pci_devices' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] End _get_guest_xml xml=<domain type="kvm">
Jul 27 10:20:32 user nova-compute[70374]:   <uuid>71366ca3-fb7d-487d-b1a6-b7daa937e960</uuid>
Jul 27 10:20:32 user nova-compute[70374]:   <name>instance-00000033</name>
Jul 27 10:20:32 user nova-compute[70374]:   <memory>524288</memory>
Jul 27 10:20:32 user nova-compute[70374]:   <vcpu>1</vcpu>
Jul 27 10:20:32 user nova-compute[70374]:   <metadata>
Jul 27 10:20:32 user nova-compute[70374]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 10:20:32 user nova-compute[70374]:       <nova:package version="0.0.0"/>
Jul 27 10:20:32 user nova-compute[70374]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1783029299</nova:name>
Jul 27 10:20:32 user nova-compute[70374]:       <nova:creationTime>2023-07-27 10:20:32</nova:creationTime>
Jul 27 10:20:32 user nova-compute[70374]:       <nova:flavor name="m1.tiny">
Jul 27 10:20:32 user nova-compute[70374]:         <nova:memory>512</nova:memory>
Jul 27 10:20:32 user nova-compute[70374]:         <nova:disk>1</nova:disk>
Jul 27 10:20:32 user nova-compute[70374]:         <nova:swap>0</nova:swap>
Jul 27 10:20:32 user nova-compute[70374]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 10:20:32 user nova-compute[70374]:         <nova:vcpus>1</nova:vcpus>
Jul 27 10:20:32 user nova-compute[70374]:       </nova:flavor>
Jul 27 10:20:32 user nova-compute[70374]:       <nova:owner>
Jul 27 10:20:32 user nova-compute[70374]:         <nova:user uuid="51563e190dfb4da2b572b5f392ef1798">tempest-SnapshotDataIntegrityTests-1391447189-project-member</nova:user>
Jul 27 10:20:32 user nova-compute[70374]:         <nova:project uuid="33dd24825a734adaaebeaf4f369309bc">tempest-SnapshotDataIntegrityTests-1391447189</nova:project>
Jul 27 10:20:32 user nova-compute[70374]:       </nova:owner>
Jul 27 10:20:32 user nova-compute[70374]:       <nova:root type="image" uuid="35458adf-261a-4e0b-a4db-b243619b2394"/>
Jul 27 10:20:32 user nova-compute[70374]:       <nova:ports>
Jul 27 10:20:32 user nova-compute[70374]:         <nova:port uuid="58b78302-b6e5-483a-a57b-9abc88c95374">
Jul 27 10:20:32 user nova-compute[70374]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 10:20:32 user nova-compute[70374]:         </nova:port>
Jul 27 10:20:32 user nova-compute[70374]:       </nova:ports>
Jul 27 10:20:32 user nova-compute[70374]:     </nova:instance>
Jul 27 10:20:32 user nova-compute[70374]:   </metadata>
Jul 27 10:20:32 user nova-compute[70374]:   <sysinfo type="smbios">
Jul 27 10:20:32 user nova-compute[70374]:     <system>
Jul 27 10:20:32 user nova-compute[70374]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 10:20:32 user nova-compute[70374]:       <entry name="product">OpenStack Nova</entry>
Jul 27 10:20:32 user nova-compute[70374]:       <entry name="version">0.0.0</entry>
Jul 27 10:20:32 user nova-compute[70374]:       <entry name="serial">71366ca3-fb7d-487d-b1a6-b7daa937e960</entry>
Jul 27 10:20:32 user nova-compute[70374]:       <entry name="uuid">71366ca3-fb7d-487d-b1a6-b7daa937e960</entry>
Jul 27 10:20:32 user nova-compute[70374]:       <entry name="family">Virtual Machine</entry>
Jul 27 10:20:32 user nova-compute[70374]:     </system>
Jul 27 10:20:32 user nova-compute[70374]:   </sysinfo>
Jul 27 10:20:32 user nova-compute[70374]:   <os>
Jul 27 10:20:32 user nova-compute[70374]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 10:20:32 user nova-compute[70374]:     <boot dev="hd"/>
Jul 27 10:20:32 user nova-compute[70374]:     <smbios mode="sysinfo"/>
Jul 27 10:20:32 user nova-compute[70374]:   </os>
Jul 27 10:20:32 user nova-compute[70374]:   <features>
Jul 27 10:20:32 user nova-compute[70374]:     <acpi/>
Jul 27 10:20:32 user nova-compute[70374]:     <apic/>
Jul 27 10:20:32 user nova-compute[70374]:     <vmcoreinfo/>
Jul 27 10:20:32 user nova-compute[70374]:   </features>
Jul 27 10:20:32 user nova-compute[70374]:   <clock offset="utc">
Jul 27 10:20:32 user nova-compute[70374]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 10:20:32 user nova-compute[70374]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 10:20:32 user nova-compute[70374]:     <timer name="hpet" present="no"/>
Jul 27 10:20:32 user nova-compute[70374]:   </clock>
Jul 27 10:20:32 user nova-compute[70374]:   <cpu mode="custom" match="exact">
Jul 27 10:20:32 user nova-compute[70374]:     <model>Nehalem</model>
Jul 27 10:20:32 user nova-compute[70374]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 10:20:32 user nova-compute[70374]:   </cpu>
Jul 27 10:20:32 user nova-compute[70374]:   <devices>
Jul 27 10:20:32 user nova-compute[70374]:     <disk type="file" device="disk">
Jul 27 10:20:32 user nova-compute[70374]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 10:20:32 user nova-compute[70374]:       <source file="/opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk"/>
Jul 27 10:20:32 user nova-compute[70374]:       <target dev="vda" bus="virtio"/>
Jul 27 10:20:32 user nova-compute[70374]:     </disk>
Jul 27 10:20:32 user nova-compute[70374]:     <interface type="ethernet">
Jul 27 10:20:32 user nova-compute[70374]:       <mac address="fa:16:3e:ab:46:8c"/>
Jul 27 10:20:32 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:20:32 user nova-compute[70374]:       <mtu size="1442"/>
Jul 27 10:20:32 user nova-compute[70374]:       <target dev="tap58b78302-b6"/>
Jul 27 10:20:32 user nova-compute[70374]:     </interface>
Jul 27 10:20:32 user nova-compute[70374]:     <serial type="pty">
Jul 27 10:20:32 user nova-compute[70374]:       <log file="/opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/console.log" append="off"/>
Jul 27 10:20:32 user nova-compute[70374]:     </serial>
Jul 27 10:20:32 user nova-compute[70374]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 10:20:32 user nova-compute[70374]:     <video>
Jul 27 10:20:32 user nova-compute[70374]:       <model type="virtio"/>
Jul 27 10:20:32 user nova-compute[70374]:     </video>
Jul 27 10:20:32 user nova-compute[70374]:     <rng model="virtio">
Jul 27 10:20:32 user nova-compute[70374]:       <backend model="random">/dev/urandom</backend>
Jul 27 10:20:32 user nova-compute[70374]:     </rng>
Jul 27 10:20:32 user nova-compute[70374]:     <controller type="usb" index="0" model="none"/>
Jul 27 10:20:32 user nova-compute[70374]:     <memballoon model="virtio">
Jul 27 10:20:32 user nova-compute[70374]:       <stats period="10"/>
Jul 27 10:20:32 user nova-compute[70374]:     </memballoon>
Jul 27 10:20:32 user nova-compute[70374]:   </devices>
Jul 27 10:20:32 user nova-compute[70374]: </domain>
Jul 27 10:20:32 user nova-compute[70374]:  {{(pid=70374) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:20:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1783029299',display_name='tempest-SnapshotDataIntegrityTests-server-1783029299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1783029299',id=51,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+6/HxS1LtWajP4GzNjORxWg/w36mnu0Qd7nFTUgPTjagZ23Wz4zqmkLbU2+du9dcKL1G3yoHCKFYfFqQg033HJ2ULmSGWfSklOEkGOYSHe06wmuIYrpoWueC/gH3Vzw==',key_name='tempest-keypair-244904466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33dd24825a734adaaebeaf4f369309bc',ramdisk_id='',reservation_id='r-190gy0lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1391447189',owner_user_name='tempest-SnapshotDataIntegrityTests-1391447189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T10:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51563e190dfb4da2b572b5f392ef1798',uuid=71366ca3-fb7d-487d-b1a6-b7daa937e960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Converting VIF {"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:46:8c,bridge_name='br-int',has_traffic_filtering=True,id=58b78302-b6e5-483a-a57b-9abc88c95374,network=Network(de0e1c71-acd9-4caf-ae3c-36eaefca932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b78302-b6') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG os_vif [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:46:8c,bridge_name='br-int',has_traffic_filtering=True,id=58b78302-b6e5-483a-a57b-9abc88c95374,network=Network(de0e1c71-acd9-4caf-ae3c-36eaefca932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b78302-b6') {{(pid=70374) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58b78302-b6, may_exist=True, interface_attrs={}) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58b78302-b6, col_values=(('external_ids', {'iface-id': '58b78302-b6e5-483a-a57b-9abc88c95374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:46:8c', 'vm-uuid': '71366ca3-fb7d-487d-b1a6-b7daa937e960'}),), if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:32 user nova-compute[70374]: INFO os_vif [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:46:8c,bridge_name='br-int',has_traffic_filtering=True,id=58b78302-b6e5-483a-a57b-9abc88c95374,network=Network(de0e1c71-acd9-4caf-ae3c-36eaefca932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b78302-b6')
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No VIF found with MAC fa:16:3e:ab:46:8c, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-c9018da7-a33d-472c-abad-eddec80a7749 req-ec7218a3-f620-405d-9dbe-07c165b6a4ca service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated VIF entry in instance network info cache for port 58b78302-b6e5-483a-a57b-9abc88c95374. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG nova.network.neutron [req-c9018da7-a33d-472c-abad-eddec80a7749 req-ec7218a3-f620-405d-9dbe-07c165b6a4ca service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:20:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-c9018da7-a33d-472c-abad-eddec80a7749 req-ec7218a3-f620-405d-9dbe-07c165b6a4ca service nova] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:20:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-251b6725-5c88-4dd7-bc3f-5eeebd069348 req-65f8ff15-6fe2-4d9a-8593-b00e77f0c32e service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received event network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:20:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-251b6725-5c88-4dd7-bc3f-5eeebd069348 req-65f8ff15-6fe2-4d9a-8593-b00e77f0c32e service nova] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-251b6725-5c88-4dd7-bc3f-5eeebd069348 req-65f8ff15-6fe2-4d9a-8593-b00e77f0c32e service nova] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:34 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-251b6725-5c88-4dd7-bc3f-5eeebd069348 req-65f8ff15-6fe2-4d9a-8593-b00e77f0c32e service nova] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:34 user nova-compute[70374]: DEBUG nova.compute.manager [req-251b6725-5c88-4dd7-bc3f-5eeebd069348 req-65f8ff15-6fe2-4d9a-8593-b00e77f0c32e service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] No waiting events found dispatching network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:20:34 user nova-compute[70374]: WARNING nova.compute.manager [req-251b6725-5c88-4dd7-bc3f-5eeebd069348 req-65f8ff15-6fe2-4d9a-8593-b00e77f0c32e service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received unexpected event network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 for instance with vm_state building and task_state spawning.
Jul 27 10:20:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:34 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690453235.8802876, 71366ca3-fb7d-487d-b1a6-b7daa937e960 => Resumed> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:20:35 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] VM Resumed (Lifecycle Event)
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Instance event wait completed in 0 seconds for  {{(pid=70374) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Guest created on hypervisor {{(pid=70374) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:35 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Instance spawned successfully.
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Found default for hw_cdrom_bus of ide {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Found default for hw_disk_bus of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Found default for hw_input_bus of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Found default for hw_pointer_model of None {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Found default for hw_video_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Found default for hw_vif_model of virtio {{(pid=70374) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 10:20:35 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.virt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Emitting event <LifecycleEvent: 1690453235.8820019, 71366ca3-fb7d-487d-b1a6-b7daa937e960 => Started> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:20:35 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] VM Started (Lifecycle Event)
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:20:35 user nova-compute[70374]: DEBUG nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70374) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 10:20:36 user nova-compute[70374]: INFO nova.compute.manager [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 10:20:36 user nova-compute[70374]: INFO nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Took 5.95 seconds to spawn the instance on the hypervisor.
Jul 27 10:20:36 user nova-compute[70374]: DEBUG nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:20:36 user nova-compute[70374]: INFO nova.compute.manager [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Took 6.55 seconds to build instance.
Jul 27 10:20:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-a04e0aa7-d8d5-464d-b55d-fdc36158d721 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.689s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-f507ec28-5ac1-4f1f-ad34-a953d8c1cec4 req-7a13c005-756e-48b6-a263-9ce033e09a1c service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received event network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:20:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f507ec28-5ac1-4f1f-ad34-a953d8c1cec4 req-7a13c005-756e-48b6-a263-9ce033e09a1c service nova] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f507ec28-5ac1-4f1f-ad34-a953d8c1cec4 req-7a13c005-756e-48b6-a263-9ce033e09a1c service nova] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:36 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-f507ec28-5ac1-4f1f-ad34-a953d8c1cec4 req-7a13c005-756e-48b6-a263-9ce033e09a1c service nova] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:36 user nova-compute[70374]: DEBUG nova.compute.manager [req-f507ec28-5ac1-4f1f-ad34-a953d8c1cec4 req-7a13c005-756e-48b6-a263-9ce033e09a1c service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] No waiting events found dispatching network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:20:36 user nova-compute[70374]: WARNING nova.compute.manager [req-f507ec28-5ac1-4f1f-ad34-a953d8c1cec4 req-7a13c005-756e-48b6-a263-9ce033e09a1c service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received unexpected event network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 for instance with vm_state active and task_state None.
Jul 27 10:20:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:20:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:20:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:50 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:20:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:20:54 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:20:54 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:20:54 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.198806762695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:20:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:20:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:56 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:20:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:20:58 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:16 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:21:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:21:36 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:21:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:21:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:21:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:21:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:21:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:21:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:21:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:21:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:21:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:21:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:21:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:21:48 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:21:50 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:21:53 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 10:21:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:21:55 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:21:56 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:21:56 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.196495056152344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:21:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:21:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:21:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:07 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:07 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 10:22:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:22:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:22:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:22:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:22:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:22:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-99d1fac0-98a0-4908-be3b-9ea565711936 req-3a77878a-e6f9-4bd0-998a-d24f1b76d3ec service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received event network-changed-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:22:20 user nova-compute[70374]: DEBUG nova.compute.manager [req-99d1fac0-98a0-4908-be3b-9ea565711936 req-3a77878a-e6f9-4bd0-998a-d24f1b76d3ec service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Refreshing instance network info cache due to event network-changed-58b78302-b6e5-483a-a57b-9abc88c95374. {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 10:22:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-99d1fac0-98a0-4908-be3b-9ea565711936 req-3a77878a-e6f9-4bd0-998a-d24f1b76d3ec service nova] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:22:20 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-99d1fac0-98a0-4908-be3b-9ea565711936 req-3a77878a-e6f9-4bd0-998a-d24f1b76d3ec service nova] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:22:20 user nova-compute[70374]: DEBUG nova.network.neutron [req-99d1fac0-98a0-4908-be3b-9ea565711936 req-3a77878a-e6f9-4bd0-998a-d24f1b76d3ec service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Refreshing network info cache for port 58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 10:22:20 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:21 user nova-compute[70374]: DEBUG nova.network.neutron [req-99d1fac0-98a0-4908-be3b-9ea565711936 req-3a77878a-e6f9-4bd0-998a-d24f1b76d3ec service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated VIF entry in instance network info cache for port 58b78302-b6e5-483a-a57b-9abc88c95374. {{(pid=70374) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 10:22:21 user nova-compute[70374]: DEBUG nova.network.neutron [req-99d1fac0-98a0-4908-be3b-9ea565711936 req-3a77878a-e6f9-4bd0-998a-d24f1b76d3ec service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:22:21 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-99d1fac0-98a0-4908-be3b-9ea565711936 req-3a77878a-e6f9-4bd0-998a-d24f1b76d3ec service nova] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:22:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG nova.objects.instance [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:22:24 user nova-compute[70374]: INFO nova.compute.manager [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attaching volume 98fb8d8e-bf57-4027-8442-3c83168c8e34 to /dev/vdb
Jul 27 10:22:24 user nova-compute[70374]: DEBUG os_brick.utils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[32039d4a-5f5d-420d-9608-8b82e62a204a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c4861c-e03f-4dc3-8810-d4ef8b94603a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c219df9-cfac-4d75-a5f5-a59c3d5839bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a3391-063f-4195-a93a-973e9ac5258d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:22:24 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:22:24 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[940ef377-4dd0-4297-981c-dc740547dab2]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG os_brick.utils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:22:24 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating existing volume attachment record: 6aaf8257-509c-44e0-b970-fc1123a183bb {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:22:25 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqmvBitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:22:30 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:22:30 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:22:30 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[026890df-0659-4170-8cbc-71d5d86ee312]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:22:30 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c828ca1-b3b4-4acf-af61-25af4efd79d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34] added
Jul 27 10:22:30 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa582fa-08e4-437b-920c-5d0b16f487bf]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc633b-6dd5-4f1d-90b0-f28887026e76]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqmvBitL {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqmvBitL" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebd9ff1-e48f-4f1a-973f-eeac57f7101c]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xqmvBitL'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:30 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0265a4ef-0f94-4134-a1a5-c957c1115c47]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[83174bad-4ea2-49b7-8943-29184c1384d7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:22:31 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:22:31 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:22:31 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 10:22:31 user nova-compute[70374]: 
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4107b5ce-d1f6-4125-951a-c9ba6726c9e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34, portal: 172.16.0.220,3260]
Jul 27 10:22:31 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34, portal: 172.16.0.220,3260] successful.
Jul 27 10:22:31 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd8641b-80b0-4771-8607-51226b61a20a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6e383d-8962-4222-abb5-2c3c903f859a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 (non-flash)
Jul 27 10:22:31 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 (non-flash)
Jul 27 10:22:31 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4359624a-5b4d-4442-85cf-beff413a10f7]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:22:31 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqmvBitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23161313135383734', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161313135383734', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG nova.objects.instance [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 10:22:32 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:22:32 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:22:32 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:22:32 user nova-compute[70374]:   <serial>98fb8d8e-bf57-4027-8442-3c83168c8e34</serial>
Jul 27 10:22:32 user nova-compute[70374]: </disk>
Jul 27 10:22:32 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No VIF found with MAC fa:16:3e:ab:46:8c, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:22:32 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-12be6912-6e9c-4dbb-82ad-7bb448e74e4a tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.325s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:22:35 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:37 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:40 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:46 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:22:46 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:22:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:22:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:22:46 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:22:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:22:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:22:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:22:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:22:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:50 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:50 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:22:51 user nova-compute[70374]: INFO nova.compute.manager [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Detaching volume 98fb8d8e-bf57-4027-8442-3c83168c8e34
Jul 27 10:22:51 user nova-compute[70374]: INFO nova.virt.block_device [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attempting to driver detach volume 98fb8d8e-bf57-4027-8442-3c83168c8e34 from mountpoint /dev/vdb
Jul 27 10:22:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Attempting to detach device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 10:22:51 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:22:51 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:22:51 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:22:51 user nova-compute[70374]:   <serial>98fb8d8e-bf57-4027-8442-3c83168c8e34</serial>
Jul 27 10:22:51 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 10:22:51 user nova-compute[70374]: </disk>
Jul 27 10:22:51 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 10:22:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully detached device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the persistent domain config.
Jul 27 10:22:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 10:22:51 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:22:51 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:22:51 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:22:51 user nova-compute[70374]:   <serial>98fb8d8e-bf57-4027-8442-3c83168c8e34</serial>
Jul 27 10:22:51 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 10:22:51 user nova-compute[70374]: </disk>
Jul 27 10:22:51 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690453371.6072776, 71366ca3-fb7d-487d-b1a6-b7daa937e960 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 10:22:51 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully detached device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the live domain config.
Jul 27 10:22:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqmvBitL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:22:51 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76de742-3d0f-4658-9e99-948ec4755ab3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:22:51 user nova-compute[70374]: No targets found.
Jul 27 10:22:51 user nova-compute[70374]: iSNS:
Jul 27 10:22:51 user nova-compute[70374]: No targets found.
Jul 27 10:22:51 user nova-compute[70374]: STATIC:
Jul 27 10:22:51 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34
Jul 27 10:22:51 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:22:51 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:22:51 user nova-compute[70374]: FIRMWARE:
Jul 27 10:22:51 user nova-compute[70374]: No targets found.
Jul 27 10:22:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:22:51 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:22:51 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b495ffb0-6bd8-4216-b249-ade2e7e0e9a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c820a090-d889-402b-a1ce-848cdaaffde9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 (non-flash)
Jul 27 10:22:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 (non-flash)
Jul 27 10:22:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc21ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4d0420-068e-4fc0-a1b1-40699fb9cdc3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b6319f-37c9-4089-b2c4-b8e768af3664]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[492ad773-bfa0-4aa9-b911-acadd955fc87]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[297154a2-d00a-4304-aab9-85d05aaa26b4]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eaf93a-3c76-4d4d-8162-bdce9c4ee456]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.132s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2154b062-2222-43dd-be38-611827ae7dba]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34, portal: 172.16.0.220,3260]
Jul 27 10:22:51 user nova-compute[70374]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34, portal: 172.16.0.220,3260] successful.
Jul 27 10:22:51 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98fb8d8e-bf57-4027-8442-3c83168c8e34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36f90b5-565f-4558-8b24-ea2bc7904919]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== disconnect_volume: return (374ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:22:51 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:22:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:22:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:22:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-8b9bdfda-7f94-4552-89c7-0904f254d6e5 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.653s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:22:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:22:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:22:58 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:22:58 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:22:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.195091247558594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:22:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:22:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:23:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:23:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:23:20 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:39 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:45 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:23:46 user nova-compute[70374]: INFO nova.compute.manager [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attaching volume 567ce5bf-156d-4d6c-ae57-d05cc7a26889 to /dev/vdb
Jul 27 10:23:46 user nova-compute[70374]: DEBUG os_brick.utils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2aece3-c407-45a1-ac73-c2529808f832]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb57d26e-b704-4626-bdd7-01b6682a0fc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf877cfd-2beb-446f-85e2-5a9f2c229d35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddf95a1-4c01-4cbc-8ab9-f618d31f6536]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:23:46 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:23:46 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f28d519-cb75-45b1-8d7f-03062c939578]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG os_brick.utils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:23:46 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating existing volume attachment record: 470ffec6-53f2-4a90-a3dc-f672cb59e20b {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:23:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:23:50 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJqGkKjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:23:52 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:23:52 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:23:52 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7395b4d0-84c1-49f7-8e50-ad00c98ed2eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:23:52 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a1fbf4-9b15-4e71-a3ef-68bbd6786f16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889] added
Jul 27 10:23:52 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[207f311b-c7fb-47c6-abbf-72768591838b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17b8675-80c9-4a90-9d41-c4425d1a7ddd]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJqGkKjI {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJqGkKjI" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a06bac-c04e-48b9-bfe0-82695fa57134]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iJqGkKjI'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15f69fb-0528-4182-a10c-606fafb37cb3]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:52 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588c3cf-7a46-4b67-a083-143761ac8013]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:23:53 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:23:53 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:23:53 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 10:23:53 user nova-compute[70374]: 
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13f7596-777e-46e5-a95d-eaf8658bb53b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889, portal: 172.16.0.220,3260]
Jul 27 10:23:53 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889, portal: 172.16.0.220,3260] successful.
Jul 27 10:23:53 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc2edb2-94d7-4e53-acf9-a8cd69ad983b]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc0f874-ff79-43f8-847b-8bbe6258a16f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 (non-flash)
Jul 27 10:23:53 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 (non-flash)
Jul 27 10:23:53 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf5ae5-405c-4652-87e5-3b1933b968e7]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:23:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJqGkKjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23463313862633536', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463313862633536', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG nova.objects.instance [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 10:23:54 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:23:54 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:23:54 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:23:54 user nova-compute[70374]:   <serial>567ce5bf-156d-4d6c-ae57-d05cc7a26889</serial>
Jul 27 10:23:54 user nova-compute[70374]: </disk>
Jul 27 10:23:54 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No VIF found with MAC fa:16:3e:ab:46:8c, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:23:54 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-b40272f2-2002-4926-a2a4-9242d804997c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.311s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:23:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:56 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:23:56 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:23:56 user nova-compute[70374]: INFO nova.compute.manager [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Detaching volume 567ce5bf-156d-4d6c-ae57-d05cc7a26889
Jul 27 10:23:56 user nova-compute[70374]: INFO nova.virt.block_device [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attempting to driver detach volume 567ce5bf-156d-4d6c-ae57-d05cc7a26889 from mountpoint /dev/vdb
Jul 27 10:23:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Attempting to detach device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 10:23:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 10:23:56 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:23:56 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:23:56 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:23:56 user nova-compute[70374]:   <serial>567ce5bf-156d-4d6c-ae57-d05cc7a26889</serial>
Jul 27 10:23:56 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 10:23:56 user nova-compute[70374]: </disk>
Jul 27 10:23:56 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 10:23:56 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully detached device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the persistent domain config.
Jul 27 10:23:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 10:23:56 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 10:23:56 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:23:56 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:23:56 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:23:56 user nova-compute[70374]:   <serial>567ce5bf-156d-4d6c-ae57-d05cc7a26889</serial>
Jul 27 10:23:56 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 10:23:56 user nova-compute[70374]: </disk>
Jul 27 10:23:56 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690453437.0926733, 71366ca3-fb7d-487d-b1a6-b7daa937e960 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 10:23:57 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully detached device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the live domain config.
Jul 27 10:23:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJqGkKjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:23:57 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[99740d3b-5e68-4c37-9665-93f21ac7ccf6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:23:57 user nova-compute[70374]: No targets found.
Jul 27 10:23:57 user nova-compute[70374]: iSNS:
Jul 27 10:23:57 user nova-compute[70374]: No targets found.
Jul 27 10:23:57 user nova-compute[70374]: STATIC:
Jul 27 10:23:57 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889
Jul 27 10:23:57 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:23:57 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:23:57 user nova-compute[70374]: FIRMWARE:
Jul 27 10:23:57 user nova-compute[70374]: No targets found.
Jul 27 10:23:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:23:57 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:23:57 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc064e13-6a14-4168-ae27-46b6495033ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea2a276-ba1f-4e9a-a2a3-16ec6518df68]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 (non-flash)
Jul 27 10:23:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 (non-flash)
Jul 27 10:23:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc4331c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd7141c-8ed4-4822-ac96-ce1ed2650e6b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0046d825-cdb8-4f26-b64f-06c614978ed6]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[191531fa-a77d-41d6-9821-7c238b49adae]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9a908b-de13-46f3-85e7-79cb8e1abdab]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c4b120-46f7-45d8-b403-1f7278bb6224]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcee2c3-e516-4aad-a049-c7f3bb7de3f6]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889, portal: 172.16.0.220,3260]
Jul 27 10:23:57 user nova-compute[70374]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889, portal: 172.16.0.220,3260] successful.
Jul 27 10:23:57 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567ce5bf-156d-4d6c-ae57-d05cc7a26889 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[be844692-13c4-4887-84f1-5848189c8492]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== disconnect_volume: return (285ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:23:57 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:23:58 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:23:58 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:23:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.19415283203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG nova.objects.instance [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-cfedcd02-3950-4eb6-a288-698a250c36df tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:23:58 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:23:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:00 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:41 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:24:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:24:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:24:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:24:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:24:47 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:24:52 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:24:52 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:24:52 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:24:53 user nova-compute[70374]: INFO nova.compute.manager [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attaching volume 05f81023-c947-4172-b948-1476d9d6c545 to /dev/vdb
Jul 27 10:24:53 user nova-compute[70374]: DEBUG os_brick.utils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f7723b-8eda-4242-953a-f76f7e4ea171]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e57f638-d57c-4dc4-b32a-8b45351b1435]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03412f5-8b70-4475-a653-cd06028cef29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a6d4e8-6f92-45a4-a28c-e8678b582aed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:24:53 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:24:53 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[641bf0e0-822d-4441-9c25-5cd5f6e5361e]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG os_brick.utils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:24:53 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating existing volume attachment record: b803669c-0a98-44f9-8735-65bbb1aeaad7 {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:24:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:54 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:24:55 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:56 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:24:58 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:24:59 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMScUZaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:25:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:25:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:25:00 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:25:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:25:00 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:25:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.193252563476562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f9a88f-e068-47e2-af47-257885f3bff3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:25:00 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da6f720-9b28-4375-acf8-b468e9b57bde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545] added
Jul 27 10:25:00 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[1986b965-f3b8-4f8c-b0b9-b58b31cc6c20]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[bede9818-1177-469c-8bdf-0ec17f99fba9]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMScUZaW {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMScUZaW" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0788b5a0-9e88-440c-bc19-127968305c4f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YMScUZaW'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c88bf4d-46c3-44ed-a819-73d616bf8309]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c294bc73-473f-4b03-854d-a1fed86a7765]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:25:00 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:25:00 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:25:00 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 10:25:00 user nova-compute[70374]: 
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:25:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --login" returned: 0 in 1.044s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e991491-0a93-43a6-b84a-2f9c196d04b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545, portal: 172.16.0.220,3260]
Jul 27 10:25:01 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545, portal: 172.16.0.220,3260] successful.
Jul 27 10:25:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[501c8061-efbe-4f62-86c2-2287ec21b093]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9539ae99-7aa9-4876-a18e-ef07b203faaf]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 (non-flash)
Jul 27 10:25:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 (non-flash)
Jul 27 10:25:01 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.290s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa46238d-50be-42c8-919e-989ce3071620]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMScUZaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:25:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.322s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== connect_volume: return (2324ms) {'type': 'block', 'scsi_wwn': '26262363863303761', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262363863303761', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 10:25:02 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:25:02 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:25:02 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:25:02 user nova-compute[70374]:   <serial>05f81023-c947-4172-b948-1476d9d6c545</serial>
Jul 27 10:25:02 user nova-compute[70374]: </disk>
Jul 27 10:25:02 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No VIF found with MAC fa:16:3e:ab:46:8c, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:25:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0200432e-dbd6-4692-99f5-87070aec1951 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.770s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:25:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:25:05 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:25:05 user nova-compute[70374]: INFO nova.compute.manager [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Detaching volume 05f81023-c947-4172-b948-1476d9d6c545
Jul 27 10:25:05 user nova-compute[70374]: INFO nova.virt.block_device [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attempting to driver detach volume 05f81023-c947-4172-b948-1476d9d6c545 from mountpoint /dev/vdb
Jul 27 10:25:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Attempting to detach device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 10:25:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 10:25:05 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:25:05 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:25:05 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:25:05 user nova-compute[70374]:   <serial>05f81023-c947-4172-b948-1476d9d6c545</serial>
Jul 27 10:25:05 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 10:25:05 user nova-compute[70374]: </disk>
Jul 27 10:25:05 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 10:25:05 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully detached device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the persistent domain config.
Jul 27 10:25:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 10:25:05 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 10:25:05 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:25:05 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:25:05 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:25:05 user nova-compute[70374]:   <serial>05f81023-c947-4172-b948-1476d9d6c545</serial>
Jul 27 10:25:05 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 10:25:05 user nova-compute[70374]: </disk>
Jul 27 10:25:05 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 10:25:05 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690453506.1370277, 71366ca3-fb7d-487d-b1a6-b7daa937e960 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 10:25:06 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully detached device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the live domain config.
Jul 27 10:25:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMScUZaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:25:06 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52458a1-6f0d-4365-a9ed-87745c455573]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:25:06 user nova-compute[70374]: No targets found.
Jul 27 10:25:06 user nova-compute[70374]: iSNS:
Jul 27 10:25:06 user nova-compute[70374]: No targets found.
Jul 27 10:25:06 user nova-compute[70374]: STATIC:
Jul 27 10:25:06 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545
Jul 27 10:25:06 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:25:06 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:25:06 user nova-compute[70374]: FIRMWARE:
Jul 27 10:25:06 user nova-compute[70374]: No targets found.
Jul 27 10:25:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:25:06 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:25:06 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce5accc-e8b8-4dd1-bd58-d54ef2b76a14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7234cc7e-d180-4dd4-9f27-2c40995f9e6c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 (non-flash)
Jul 27 10:25:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 (non-flash)
Jul 27 10:25:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5de3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[570755fe-5413-4ec4-9dc8-449dbf998656]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[27867a70-a8ec-4bd3-977d-82766f05ba5f]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e544588b-06b7-448f-a178-5b2e1c2a9fd1]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7271ef6-d564-4ccf-9424-0b77822cd64b]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[826b8261-9fab-4768-9b03-7b0c4e0417e0]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[46797397-54ba-460f-882e-23da91ee0492]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545, portal: 172.16.0.220,3260]
Jul 27 10:25:06 user nova-compute[70374]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545, portal: 172.16.0.220,3260] successful.
Jul 27 10:25:06 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f81023-c947-4172-b948-1476d9d6c545 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd04ead-1e75-4520-aea4-0ea1a8e100ab]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== disconnect_volume: return (279ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:25:06 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:25:07 user nova-compute[70374]: DEBUG nova.objects.instance [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:25:07 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-e95f6839-e731-472a-9bbc-bfe550098b5c tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.579s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:25:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:25:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:21 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:25:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:25:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:43 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:25:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:25:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:25:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:25:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:25:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:25:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:25:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:25:54 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:25:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:25:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:25:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:25:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:25:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:25:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:00 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:26:01 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:26:01 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=25.19232177734375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:26:01 user nova-compute[70374]: INFO nova.compute.manager [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attaching volume e1e2bb38-3b87-488f-aadd-8671abbb6b30 to /dev/vdb
Jul 27 10:26:01 user nova-compute[70374]: DEBUG os_brick.utils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2f0c4-6bab-4b69-aade-5e6a0c91b312]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce3dd372cc44\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[816032ad-1886-4675-b7b2-853bed6f23e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2088ea1c-6959-42e9-9884-9ef7da6f4207]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7fb39-66ec-479c-b546-b63c5289db74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Running cmd (subprocess): nvme version {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] 'nvme version' failed. Not Retrying. {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] nvme not present on system {{(pid=70374) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 10:26:01 user nova-compute[70374]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 10:26:01 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b6fb2e-1751-41eb-b5f3-e80333a34860]: (4, '') {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70374) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.lightos [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] LIGHTOS: no hostnqn found. {{(pid=70374) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG os_brick.utils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce3dd372cc44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:26:01 user nova-compute[70374]: DEBUG nova.virt.block_device [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating existing volume attachment record: 52d1ff0b-e6e2-475d-88ac-c56a63c8dcaa {{(pid=70374) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 10:26:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:06 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Calling os-brick to attach iSCSI Volume {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmuPVjze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:26:07 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:26:07 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:26:07 user nova-compute[70374]: INFO os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e71be-0cd4-492d-94cc-e35e2011a0b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 10:26:07 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --interface default --op new {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[59189339-ceaf-45bd-a1ed-dc2a6940a4e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30] added\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30] added
Jul 27 10:26:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82ea60f-fda2-420e-ad40-6154e00f08c2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c340c0ec-3606-4201-bbda-f88a6689990a]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BmuPVjze {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BmuPVjze" returned: 0 in 0.017s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[064b6cc6-ab11-4d94-bfff-bffec444c831]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BmuPVjze'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01a07f-ff53-41a6-9c97-5bfb78d13c6f]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3df9196-fe0e-456c-9940-cfbfb0a2281a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:26:07 user nova-compute[70374]:  {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 10:26:07 user nova-compute[70374]:  {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:26:07 user nova-compute[70374]: WARNING os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 10:26:07 user nova-compute[70374]: 
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --login {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f427f-64e4-4194-88ff-7c2b76ac4ad1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30, portal: 172.16.0.220,3260]
Jul 27 10:26:07 user nova-compute[70374]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30, portal: 172.16.0.220,3260] successful.
Jul 27 10:26:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e9d8ce-a79b-4cab-a7f0-7d88fd0a3a47]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2977421e-5cd4-4f97-8599-7c0d715fa44b]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 (non-flash)
Jul 27 10:26:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 (non-flash)
Jul 27 10:26:07 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Connected to 172.16.0.220:3260 {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=70374) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70374) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6978d-1ac7-4a0e-b632-dbdf1648ad15]: (4, ('- - 0', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:07 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:26:08 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70374) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 10:26:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmuPVjze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70374) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 10:26:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:26:08 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26665356332356331', 'path': '/dev/sdb'} {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:26:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665356332356331', 'path': '/dev/sdb'} {{(pid=70374) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 10:26:08 user nova-compute[70374]: DEBUG nova.objects.instance [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:26:08 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 10:26:08 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:26:08 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:26:08 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:26:08 user nova-compute[70374]:   <serial>e1e2bb38-3b87-488f-aadd-8671abbb6b30</serial>
Jul 27 10:26:08 user nova-compute[70374]: </disk>
Jul 27 10:26:08 user nova-compute[70374]:  {{(pid=70374) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 10:26:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vda, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:26:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70374) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 10:26:09 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] No VIF found with MAC fa:16:3e:ab:46:8c, not building metadata {{(pid=70374) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 10:26:09 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-0f61cd6f-fecd-4a37-a4a7-56f616e024cf tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.189s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:26:11 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:26:11 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:26:11 user nova-compute[70374]: INFO nova.compute.manager [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Detaching volume e1e2bb38-3b87-488f-aadd-8671abbb6b30
Jul 27 10:26:11 user nova-compute[70374]: INFO nova.virt.block_device [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Attempting to driver detach volume e1e2bb38-3b87-488f-aadd-8671abbb6b30 from mountpoint /dev/vdb
Jul 27 10:26:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Attempting to detach device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the persistent domain config. {{(pid=70374) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 10:26:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 10:26:11 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:26:11 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:26:11 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:26:11 user nova-compute[70374]:   <serial>e1e2bb38-3b87-488f-aadd-8671abbb6b30</serial>
Jul 27 10:26:11 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 10:26:11 user nova-compute[70374]: </disk>
Jul 27 10:26:11 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 10:26:11 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully detached device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the persistent domain config.
Jul 27 10:26:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the live domain config. {{(pid=70374) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 10:26:11 user nova-compute[70374]: DEBUG nova.virt.libvirt.guest [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 10:26:11 user nova-compute[70374]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 10:26:11 user nova-compute[70374]:   <source dev="/dev/sdb"/>
Jul 27 10:26:11 user nova-compute[70374]:   <target dev="vdb" bus="virtio"/>
Jul 27 10:26:11 user nova-compute[70374]:   <serial>e1e2bb38-3b87-488f-aadd-8671abbb6b30</serial>
Jul 27 10:26:11 user nova-compute[70374]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 10:26:11 user nova-compute[70374]: </disk>
Jul 27 10:26:11 user nova-compute[70374]:  {{(pid=70374) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-4d7e72c1-4e89-4f44-806a-b66f03d5d874 None None] Received event <DeviceRemovedEvent: 1690453572.0712576, 71366ca3-fb7d-487d-b1a6-b7daa937e960 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70374) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.driver [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 10:26:12 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully detached device vdb from instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 from the live domain config.
Jul 27 10:26:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] calling os-brick to detach iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27fc3caf50>, {'target_iqn': 'iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmuPVjze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 10:26:12 user nova-compute[70374]: WARNING os_brick.initiator.connectors.base [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[2527b288-d5fb-43ad-99c3-e904332afa9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 10:26:12 user nova-compute[70374]: No targets found.
Jul 27 10:26:12 user nova-compute[70374]: iSNS:
Jul 27 10:26:12 user nova-compute[70374]: No targets found.
Jul 27 10:26:12 user nova-compute[70374]: STATIC:
Jul 27 10:26:12 user nova-compute[70374]: Target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30
Jul 27 10:26:12 user nova-compute[70374]:         Portal: 172.16.0.220:3260,-1
Jul 27 10:26:12 user nova-compute[70374]:                 Iface Name: default
Jul 27 10:26:12 user nova-compute[70374]: FIRMWARE:
Jul 27 10:26:12 user nova-compute[70374]: No targets found.
Jul 27 10:26:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 10:26:12 user nova-compute[70374]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 10:26:12 user nova-compute[70374]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70374) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30', 0)] {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2a04c0-c2ab-4248-9af0-84b739bc6ad6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c13e8ed-cfa3-44a4-8e04-82875b0158cf]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 (non-flash)\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 (non-flash)
Jul 27 10:26:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 (non-flash)
Jul 27 10:26:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27dc5f05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30'): ({'sdb'}, set())}) {{(pid=70374) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Removing single pathed devices sdb {{(pid=70374) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[60609315-b26b-4682-98cd-b2170c1dac9b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[e277b597-ce8d-4cdc-bf33-f396290654cd]: (4, ('ok\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Flushing IO for device /dev/sdb {{(pid=70374) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[df900b68-e30a-45f8-8187-9e9006d39dc2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70374) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67aca45-3910-430c-a695-4e160c437240]: (4, ('1', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.linuxscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] SCSI volumes sdb have been removed. {{(pid=70374) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30')] {{(pid=70374) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[6000dc69-190e-43e2-a5ed-a665ae9810c2]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --logout {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4e1a3-0f01-452d-858b-7bccadc6877b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30, portal: 172.16.0.220,3260]
Jul 27 10:26:12 user nova-compute[70374]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30, portal: 172.16.0.220,3260] successful.
Jul 27 10:26:12 user nova-compute[70374]:  stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op delete {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e2bb38-3b87-488f-aadd-8671abbb6b30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82164) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a4341-a08a-4bf6-8ce6-0d7766377c63]: (4, ('', '')) {{(pid=82164) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70374) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.base [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] <== disconnect_volume: return (266ms) None {{(pid=70374) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Disconnected iSCSI Volume {{(pid=70374) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 10:26:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:13 user nova-compute[70374]: DEBUG nova.objects.instance [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'flavor' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:26:13 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-df6c5a0f-260f-4736-ad15-c19d63bc7665 tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.604s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:26:16 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:35 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:26:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:26:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:26:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:26:37 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:42 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:47 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:49 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:26:49 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:26:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 10:26:49 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquired lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 10:26:49 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Forcefully refreshing network info cache for instance {{(pid=70374) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 10:26:49 user nova-compute[70374]: DEBUG nova.objects.instance [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lazy-loading 'info_cache' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:26:50 user nova-compute[70374]: DEBUG nova.network.neutron [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [{"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:26:50 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Releasing lock "refresh_cache-71366ca3-fb7d-487d-b1a6-b7daa937e960" {{(pid=70374) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 10:26:50 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updated the network info_cache for instance {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 10:26:52 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:55 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:26:55 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:26:57 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:26:59 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 10:27:01 user nova-compute[70374]: DEBUG oslo_concurrency.processutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70374) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 10:27:02 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:27:02 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.191394805908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Instance 71366ca3-fb7d-487d-b1a6-b7daa937e960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70374) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing inventories for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating ProviderTree inventory for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Updating inventory in ProviderTree for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing aggregate associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, aggregates: None {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Refreshing trait associations for resource provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE2 {{(pid=70374) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] There are 0 instances to clean {{(pid=70374) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 10:27:02 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:27:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:07 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:27:12 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:14 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:14 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Cleaning up deleted instances with incomplete migration  {{(pid=70374) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 10:27:17 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:22 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:24 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:31 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:31 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._sync_power_states {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:31 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Triggering sync for uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 10:27:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:27:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:27:31 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:27:32 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:27:33 user nova-compute[70374]: INFO nova.compute.manager [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Terminating instance
Jul 27 10:27:33 user nova-compute[70374]: DEBUG nova.compute.manager [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Start destroying the instance on the hypervisor. {{(pid=70374) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-48432ba4-84b0-4392-a14e-11224f0d6b4d req-b06af068-2b28-4e71-b2f3-0728f4d76d24 service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received event network-vif-unplugged-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48432ba4-84b0-4392-a14e-11224f0d6b4d req-b06af068-2b28-4e71-b2f3-0728f4d76d24 service nova] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48432ba4-84b0-4392-a14e-11224f0d6b4d req-b06af068-2b28-4e71-b2f3-0728f4d76d24 service nova] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-48432ba4-84b0-4392-a14e-11224f0d6b4d req-b06af068-2b28-4e71-b2f3-0728f4d76d24 service nova] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-48432ba4-84b0-4392-a14e-11224f0d6b4d req-b06af068-2b28-4e71-b2f3-0728f4d76d24 service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] No waiting events found dispatching network-vif-unplugged-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG nova.compute.manager [req-48432ba4-84b0-4392-a14e-11224f0d6b4d req-b06af068-2b28-4e71-b2f3-0728f4d76d24 service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received event network-vif-unplugged-58b78302-b6e5-483a-a57b-9abc88c95374 for instance with task_state deleting. {{(pid=70374) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:33 user nova-compute[70374]: INFO nova.virt.libvirt.driver [-] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Instance destroyed successfully.
Jul 27 10:27:33 user nova-compute[70374]: DEBUG nova.objects.instance [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lazy-loading 'resources' on Instance uuid 71366ca3-fb7d-487d-b1a6-b7daa937e960 {{(pid=70374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG nova.virt.libvirt.vif [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T10:20:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1783029299',display_name='tempest-SnapshotDataIntegrityTests-server-1783029299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1783029299',id=51,image_ref='35458adf-261a-4e0b-a4db-b243619b2394',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+6/HxS1LtWajP4GzNjORxWg/w36mnu0Qd7nFTUgPTjagZ23Wz4zqmkLbU2+du9dcKL1G3yoHCKFYfFqQg033HJ2ULmSGWfSklOEkGOYSHe06wmuIYrpoWueC/gH3Vzw==',key_name='tempest-keypair-244904466',keypairs=<?>,launch_index=0,launched_at=2023-07-27T10:20:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33dd24825a734adaaebeaf4f369309bc',ramdisk_id='',reservation_id='r-190gy0lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35458adf-261a-4e0b-a4db-b243619b2394',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1391447189',owner_user_name='tempest-SnapshotDataIntegrityTests-1391447189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T10:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51563e190dfb4da2b572b5f392ef1798',uuid=71366ca3-fb7d-487d-b1a6-b7daa937e960,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Converting VIF {"id": "58b78302-b6e5-483a-a57b-9abc88c95374", "address": "fa:16:3e:ab:46:8c", "network": {"id": "de0e1c71-acd9-4caf-ae3c-36eaefca932a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1496006758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33dd24825a734adaaebeaf4f369309bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b78302-b6", "ovs_interfaceid": "58b78302-b6e5-483a-a57b-9abc88c95374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG nova.network.os_vif_util [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:46:8c,bridge_name='br-int',has_traffic_filtering=True,id=58b78302-b6e5-483a-a57b-9abc88c95374,network=Network(de0e1c71-acd9-4caf-ae3c-36eaefca932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b78302-b6') {{(pid=70374) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG os_vif [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:46:8c,bridge_name='br-int',has_traffic_filtering=True,id=58b78302-b6e5-483a-a57b-9abc88c95374,network=Network(de0e1c71-acd9-4caf-ae3c-36eaefca932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b78302-b6') {{(pid=70374) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58b78302-b6, bridge=br-int, if_exists=True) {{(pid=70374) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:27:33 user nova-compute[70374]: INFO os_vif [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:46:8c,bridge_name='br-int',has_traffic_filtering=True,id=58b78302-b6e5-483a-a57b-9abc88c95374,network=Network(de0e1c71-acd9-4caf-ae3c-36eaefca932a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b78302-b6')
Jul 27 10:27:33 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Deleting instance files /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960_del
Jul 27 10:27:33 user nova-compute[70374]: INFO nova.virt.libvirt.driver [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Deletion of /opt/stack/data/nova/instances/71366ca3-fb7d-487d-b1a6-b7daa937e960_del complete
Jul 27 10:27:34 user nova-compute[70374]: INFO nova.compute.manager [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 27 10:27:34 user nova-compute[70374]: DEBUG oslo.service.loopingcall [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70374) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 10:27:34 user nova-compute[70374]: DEBUG nova.compute.manager [-] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Deallocating network for instance {{(pid=70374) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 10:27:34 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] deallocate_for_instance() {{(pid=70374) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG nova.network.neutron [-] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Updating instance_info_cache with network_info: [] {{(pid=70374) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 10:27:35 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Took 1.00 seconds to deallocate network for instance.
Jul 27 10:27:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-0f1e55e2-a7f5-4d26-af80-c2d24f37531c req-9c3768f4-ad88-4854-a350-b2fdb426b585 service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received event network-vif-deleted-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:27:35 user nova-compute[70374]: INFO nova.scheduler.client.report [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Deleted allocations for instance 71366ca3-fb7d-487d-b1a6-b7daa937e960
Jul 27 10:27:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-31a50f62-eaa7-490c-996e-04568c97081e tempest-SnapshotDataIntegrityTests-1391447189 tempest-SnapshotDataIntegrityTests-1391447189-project-member] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-d1f21676-8fe8-4d4e-97ad-8470d57317c9 req-c7bce9f4-8f91-4166-9de2-e67d646a6b86 service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received event network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1f21676-8fe8-4d4e-97ad-8470d57317c9 req-c7bce9f4-8f91-4166-9de2-e67d646a6b86 service nova] Acquiring lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1f21676-8fe8-4d4e-97ad-8470d57317c9 req-c7bce9f4-8f91-4166-9de2-e67d646a6b86 service nova] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [req-d1f21676-8fe8-4d4e-97ad-8470d57317c9 req-c7bce9f4-8f91-4166-9de2-e67d646a6b86 service nova] Lock "71366ca3-fb7d-487d-b1a6-b7daa937e960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:27:35 user nova-compute[70374]: DEBUG nova.compute.manager [req-d1f21676-8fe8-4d4e-97ad-8470d57317c9 req-c7bce9f4-8f91-4166-9de2-e67d646a6b86 service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] No waiting events found dispatching network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 {{(pid=70374) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 10:27:35 user nova-compute[70374]: WARNING nova.compute.manager [req-d1f21676-8fe8-4d4e-97ad-8470d57317c9 req-c7bce9f4-8f91-4166-9de2-e67d646a6b86 service nova] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Received unexpected event network-vif-plugged-58b78302-b6e5-483a-a57b-9abc88c95374 for instance with vm_state deleted and task_state None.
Jul 27 10:27:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:27:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:27:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:27:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:27:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:48 user nova-compute[70374]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690453653.927814, 71366ca3-fb7d-487d-b1a6-b7daa937e960 => Stopped> {{(pid=70374) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 10:27:48 user nova-compute[70374]: INFO nova.compute.manager [-] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] VM Stopped (Lifecycle Event)
Jul 27 10:27:48 user nova-compute[70374]: DEBUG nova.compute.manager [None req-c0b2d8f9-16c3-4668-85bb-583cbe98d765 None None] [instance: 71366ca3-fb7d-487d-b1a6-b7daa937e960] Checking state {{(pid=70374) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 10:27:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:27:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:27:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:27:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 10:27:53 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:27:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:57 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:27:57 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70374) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 10:27:58 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:28:00 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:28:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:28:02 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager.update_available_resource {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70374) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 10:28:03 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:28:03 user nova-compute[70374]: WARNING nova.virt.libvirt.driver [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 10:28:03 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.21841049194336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=70374) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70374) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG nova.compute.provider_tree [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed in ProviderTree for provider: f7548644-4a09-4ad8-9aa6-6e05d85a9f5b {{(pid=70374) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG nova.scheduler.client.report [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Inventory has not changed for provider f7548644-4a09-4ad8-9aa6-6e05d85a9f5b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70374) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG nova.compute.resource_tracker [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Compute_service record updated for user:user {{(pid=70374) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG oslo_concurrency.lockutils [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=70374) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70374) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70374) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 10:28:03 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:28:08 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:13 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:28:18 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:23 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:28:24 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:27 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:28 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:30 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:33 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:38 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 10:28:43 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:45 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:28:48 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 10:28:51 user nova-compute[70374]: DEBUG oslo_service.periodic_task [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70374) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 10:28:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Starting heal instance info cache {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 10:28:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Rebuilding the list of instances to heal {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 10:28:51 user nova-compute[70374]: DEBUG nova.compute.manager [None req-de897f0f-b4d9-4176-abc0-9f316f88df4d None None] Didn't find any instances for network info cache update. {{(pid=70374) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 10:28:54 user nova-compute[70374]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70374) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}